Max level shown:
1 [ Aug 28 04:05:09 Enabled. ]
2 [ Aug 28 04:05:09 Rereading configuration. ]
3 [ Aug 28 04:05:11 Rereading configuration. ]
4 [ Aug 28 04:05:23 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Aug 28 04:05:23 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-08-28T04:05:23.937ZDEBGnexus: registered DTrace probes
82024-08-28T04:05:23.940ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:86
92024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
332024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
342024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
352024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
362024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
372024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
382024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
392024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
402024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
412024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
422024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
432024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
442024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
452024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
462024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
472024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
482024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
492024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
502024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
512024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
522024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
532024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
542024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
552024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
562024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
572024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
582024-08-28T04:05:23.950ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
592024-08-28T04:05:23.950ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
602024-08-28T04:05:23.967ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:214
612024-08-28T04:05:23.971ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
622024-08-28T04:05:23.977ZINFOnexus (ServerContext): Setting up qorb pool from DNS dns_addrs = [\n [fd00:1122:3344:1::1]:53,\n [fd00:1122:3344:2::1]:53,\n [fd00:1122:3344:3::1]:53,\n [fd00:1122:3344:4::1]:53,\n [fd00:1122:3344:5::1]:53,\n] file = nexus/src/context.rs:263
632024-08-28T04:05:34.057ZINFOnexus: Database schema version is up to date desired_version = 92.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 92.0.0
642024-08-28T04:05:34.060ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
652024-08-28T04:05:34.060ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1021, tv_nsec: 141672595 } })
662024-08-28T04:05:34.061ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
672024-08-28T04:05:34.112ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
682024-08-28T04:05:34.112ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
692024-08-28T04:05:34.119ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a095182f-736a-4af4-9dd8-8766dd9ad0e5", "content-length": "26", "date": "Wed, 28 Aug 2024 04:05:34 GMT"} })
702024-08-28T04:05:34.119ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
712024-08-28T04:05:34.120ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
722024-08-28T04:05:34.152ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1021, tv_nsec: 233648997 } })
732024-08-28T04:05:34.152ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
742024-08-28T04:05:34.186ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
752024-08-28T04:05:34.186ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
762024-08-28T04:05:34.187ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7d2d40c2-68ab-4e63-b3d4-d2ec5314135f", "content-length": "26", "date": "Wed, 28 Aug 2024 04:05:34 GMT"} })
772024-08-28T04:05:34.187ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
782024-08-28T04:05:34.187ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
792024-08-28T04:05:34.265ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
802024-08-28T04:05:34.275ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
812024-08-28T04:05:34.277ZDEBGnexus (DataLoader): attempting to create built-in users
822024-08-28T04:05:34.277ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
832024-08-28T04:05:34.277ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
842024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /artifacts/{kind}/{name}/{version}
852024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks
862024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /bgtasks/activate
872024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks/view/{bgtask_name}
882024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request
892024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped
902024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress
912024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish
922024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start
932024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga
942024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete
952024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all
962024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id}
972024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id}
982024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/import
992024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/regenerate
1002024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/target
1012024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/target
1022024-08-28T04:05:34.289ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /deployment/blueprints/target/enabled
1032024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent
1042024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /disks/{disk_id}
1052024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /instances/{instance_id}/migrate
1062024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/collectors
1072024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /metrics/collectors/{collector_id}/producers
1082024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/producers
1092024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /nat/ipv4/changeset/{from_gen}
1102024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /physical-disk/expunge
1112024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /probes/{sled}
1122024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /racks/{rack_id}/initialization-complete
1132024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas
1142024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas/{saga_id}
1152024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sled-agents/{sled_id}
1162024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}
1172024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update
1182024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/add
1192024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/expunge
1202024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sleds/uninitialized
1212024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /switch/{switch_id}
1222024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /vmms/{propolis_id}
1232024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent
1242024-08-28T04:05:34.290ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::b]:12221
1252024-08-28T04:05:34.290ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12221
1262024-08-28T04:05:34.291ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1272024-08-28T04:05:34.291ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1282024-08-28T04:05:34.490ZWARNnexus: Cannot look up rack: Object (of type ById(8b05f6f6-ff29-4d8c-aa09-514d34e6a880)) not found: rack file = nexus/src/app/rack.rs:771
1292024-08-28T04:05:34.561ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1302024-08-28T04:05:34.562ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1312024-08-28T04:05:34.563ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1322024-08-28T04:05:34.564ZDEBGnexus (DataLoader): attempting to create built-in roles
1332024-08-28T04:05:34.564ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1342024-08-28T04:05:34.564ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1352024-08-28T04:05:34.578ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1362024-08-28T04:05:34.579ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1372024-08-28T04:05:34.580ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1382024-08-28T04:05:34.580ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1392024-08-28T04:05:34.580ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1402024-08-28T04:05:34.580ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1412024-08-28T04:05:35.062ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1422024-08-28T04:05:35.062ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1432024-08-28T04:05:35.063ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1442024-08-28T04:05:35.063ZDEBGnexus (DataLoader): attempting to create built-in silos
1452024-08-28T04:05:35.063ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1462024-08-28T04:05:35.063ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1472024-08-28T04:05:35.244ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1482024-08-28T04:05:35.244ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1492024-08-28T04:05:35.244ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1502024-08-28T04:05:35.281ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1512024-08-28T04:05:35.282ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1522024-08-28T04:05:35.282ZDEBGnexus (DataLoader): attempting to create built-in projects
1532024-08-28T04:05:35.282ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1542024-08-28T04:05:35.282ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1552024-08-28T04:05:35.377ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1562024-08-28T04:05:35.377ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1572024-08-28T04:05:35.381ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1582024-08-28T04:05:35.382ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1592024-08-28T04:05:35.412ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1602024-08-28T04:05:35.414ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1612024-08-28T04:05:35.414ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1622024-08-28T04:05:35.414ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1632024-08-28T04:05:35.439ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1642024-08-28T04:05:35.439ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1652024-08-28T04:05:35.680ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1662024-08-28T04:05:35.682ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1672024-08-28T04:05:35.682ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1682024-08-28T04:05:35.682ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1692024-08-28T04:05:35.806ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1702024-08-28T04:05:35.806ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1712024-08-28T04:05:35.807ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1722024-08-28T04:05:35.807ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1732024-08-28T04:05:35.807ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1742024-08-28T04:05:35.807ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1752024-08-28T04:05:35.819ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1762024-08-28T04:05:35.820ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1772024-08-28T04:05:35.832ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1782024-08-28T04:05:35.832ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1792024-08-28T04:05:35.834ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1802024-08-28T04:05:35.834ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1812024-08-28T04:05:35.835ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1822024-08-28T04:05:35.836ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1832024-08-28T04:05:36.160ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1842024-08-28T04:05:36.162ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1852024-08-28T04:05:36.163ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1862024-08-28T04:05:36.163ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1872024-08-28T04:05:36.164ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1882024-08-28T04:05:36.164ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1892024-08-28T04:05:36.166ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1902024-08-28T04:05:36.166ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1912024-08-28T04:05:36.167ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1922024-08-28T04:05:36.170ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1932024-08-28T04:05:36.170ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1942024-08-28T04:05:36.170ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1952024-08-28T04:05:36.211ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1962024-08-28T04:05:36.212ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1972024-08-28T04:05:36.223ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1982024-08-28T04:05:36.223ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1992024-08-28T04:05:36.225ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2002024-08-28T04:05:36.225ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2012024-08-28T04:05:36.226ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2022024-08-28T04:05:36.226ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2032024-08-28T04:05:36.227ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2042024-08-28T04:05:36.230ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2052024-08-28T04:05:36.230ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2062024-08-28T04:05:36.231ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2072024-08-28T04:05:36.267ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2082024-08-28T04:05:36.267ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2092024-08-28T04:05:36.268ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2102024-08-28T04:05:36.269ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2112024-08-28T04:05:36.270ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2122024-08-28T04:05:36.270ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2132024-08-28T04:05:36.274ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2142024-08-28T04:05:36.277ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2152024-08-28T04:05:36.277ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2162024-08-28T04:05:36.277ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2172024-08-28T04:05:36.310ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2182024-08-28T04:05:36.311ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2192024-08-28T04:05:36.312ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2202024-08-28T04:05:36.312ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2212024-08-28T04:05:36.314ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2222024-08-28T04:05:36.314ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2232024-08-28T04:05:36.315ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2242024-08-28T04:05:36.318ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2252024-08-28T04:05:36.319ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2262024-08-28T04:05:36.319ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2272024-08-28T04:05:36.379ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2282024-08-28T04:05:36.379ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2292024-08-28T04:05:36.379ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2302024-08-28T04:05:36.382ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2312024-08-28T04:05:36.382ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2322024-08-28T04:05:36.384ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2332024-08-28T04:05:36.385ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2342024-08-28T04:05:36.391ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2352024-08-28T04:05:36.391ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2362024-08-28T04:05:36.408ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2372024-08-28T04:05:36.408ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2382024-08-28T04:05:36.413ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2392024-08-28T04:05:36.413ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2402024-08-28T04:05:36.418ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2412024-08-28T04:05:36.422ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2422024-08-28T04:05:36.422ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2432024-08-28T04:05:36.422ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2442024-08-28T04:05:36.424ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2452024-08-28T04:05:36.424ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2462024-08-28T04:05:36.426ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2472024-08-28T04:05:36.426ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2482024-08-28T04:05:36.431ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2492024-08-28T04:05:36.435ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2502024-08-28T04:05:36.435ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2512024-08-28T04:05:36.436ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2522024-08-28T04:05:36.468ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2532024-08-28T04:05:36.468ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2542024-08-28T04:05:36.470ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2552024-08-28T04:05:36.470ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2562024-08-28T04:05:36.472ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2572024-08-28T04:05:36.472ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2582024-08-28T04:05:36.474ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2592024-08-28T04:05:36.477ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2602024-08-28T04:05:36.477ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2612024-08-28T04:05:36.478ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2622024-08-28T04:05:36.491ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
2632024-08-28T04:05:36.491ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
2642024-08-28T04:05:36.492ZWARNnexus: Cannot look up rack: Object (of type ById(8b05f6f6-ff29-4d8c-aa09-514d34e6a880)) not found: rack file = nexus/src/app/rack.rs:771
2652024-08-28T04:05:36.614ZWARNnexus (datastore): Retryable transaction failure file = nexus/db-queries/src/transaction_retry.rs:160 retry_after (ms) = 3 transaction = vpc_update_firewall_rules
2662024-08-28T04:05:36.658ZINFOnexus (datastore): transaction completed attempts = 2 file = nexus/db-queries/src/transaction_retry.rs:116 transaction = vpc_update_firewall_rules
2672024-08-28T04:05:36.658ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:252
2682024-08-28T04:05:36.658ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2692024-08-28T04:05:36.658ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2702024-08-28T04:05:36.658ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2712024-08-28T04:05:36.682ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2722024-08-28T04:05:36.682ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2732024-08-28T04:05:36.684ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2742024-08-28T04:05:36.684ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2752024-08-28T04:05:36.686ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2762024-08-28T04:05:36.686ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2772024-08-28T04:05:36.687ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2782024-08-28T04:05:36.688ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2792024-08-28T04:05:36.689ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2802024-08-28T04:05:36.689ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2812024-08-28T04:05:36.690ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2822024-08-28T04:05:36.693ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2832024-08-28T04:05:36.693ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2842024-08-28T04:05:36.693ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2852024-08-28T04:05:36.696ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2862024-08-28T04:05:36.696ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2872024-08-28T04:05:36.698ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2882024-08-28T04:05:36.698ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2892024-08-28T04:05:36.699ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2902024-08-28T04:05:36.699ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2912024-08-28T04:05:36.701ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2922024-08-28T04:05:36.701ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2932024-08-28T04:05:36.702ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2942024-08-28T04:05:36.702ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2952024-08-28T04:05:36.703ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2962024-08-28T04:05:36.704ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2972024-08-28T04:05:36.705ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2982024-08-28T04:05:36.708ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
2992024-08-28T04:05:36.708ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3002024-08-28T04:05:36.708ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3012024-08-28T04:05:36.721ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3022024-08-28T04:05:36.721ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3032024-08-28T04:05:36.723ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3042024-08-28T04:05:36.723ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3052024-08-28T04:05:36.724ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3062024-08-28T04:05:36.724ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3072024-08-28T04:05:36.726ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3082024-08-28T04:05:36.728ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3092024-08-28T04:05:36.757ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3102024-08-28T04:05:36.757ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3112024-08-28T04:05:36.855ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3122024-08-28T04:05:36.856ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3132024-08-28T04:05:36.883ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3142024-08-28T04:05:36.884ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3152024-08-28T04:05:36.885ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3162024-08-28T04:05:36.885ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3172024-08-28T04:05:36.887ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3182024-08-28T04:05:36.887ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3192024-08-28T04:05:36.888ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3202024-08-28T04:05:36.891ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3212024-08-28T04:05:36.891ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3222024-08-28T04:05:36.891ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3232024-08-28T04:05:36.903ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3242024-08-28T04:05:36.903ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3252024-08-28T04:05:36.905ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3262024-08-28T04:05:36.905ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3272024-08-28T04:05:36.906ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3282024-08-28T04:05:36.906ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3292024-08-28T04:05:36.907ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3302024-08-28T04:05:36.908ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3312024-08-28T04:05:36.909ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3322024-08-28T04:05:36.909ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3332024-08-28T04:05:36.910ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3342024-08-28T04:05:36.911ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3352024-08-28T04:05:36.912ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3362024-08-28T04:05:36.912ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3372024-08-28T04:05:36.913ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3382024-08-28T04:05:36.917ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ById(001de000-c470-4000-8000-000000000003) } result = Ok(())
3392024-08-28T04:05:36.917ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:316
3402024-08-28T04:05:36.917ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:194
3412024-08-28T04:05:36.917ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3422024-08-28T04:05:36.917ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3432024-08-28T04:05:36.917ZDEBGnexus (DataLoader): attempting to create silo users
3442024-08-28T04:05:36.917ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3452024-08-28T04:05:36.917ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3462024-08-28T04:05:36.944ZINFOnexus (DataLoader): created 2 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3472024-08-28T04:05:36.944ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3482024-08-28T04:05:36.944ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3492024-08-28T04:05:36.944ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3502024-08-28T04:05:36.957ZINFOnexus (DataLoader): created 2 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3512024-08-28T04:05:36.957ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3522024-08-28T04:05:36.957ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3532024-08-28T04:05:36.972ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3542024-08-28T04:05:36.972ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3552024-08-28T04:05:36.979ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3562024-08-28T04:05:36.979ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3572024-08-28T04:05:36.980ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3582024-08-28T04:05:36.981ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3592024-08-28T04:05:36.981ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3602024-08-28T04:05:36.981ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3612024-08-28T04:05:36.992ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3622024-08-28T04:05:36.992ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3632024-08-28T04:05:36.993ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3642024-08-28T04:05:36.994ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3652024-08-28T04:05:36.994ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3662024-08-28T04:05:36.994ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3672024-08-28T04:05:37.057ZINFOnexus: populate complete file = nexus/src/app/mod.rs:513
3682024-08-28T04:05:37.057ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:522
3692024-08-28T04:05:37.063ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
3702024-08-28T04:05:37.063ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
3712024-08-28T04:05:37.063ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
3722024-08-28T04:05:37.063ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
3732024-08-28T04:05:37.063ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
3742024-08-28T04:05:37.063ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
3752024-08-28T04:05:37.063ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
3762024-08-28T04:05:37.063ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
3772024-08-28T04:05:37.063ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
3782024-08-28T04:05:37.063ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
3792024-08-28T04:05:37.063ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
3802024-08-28T04:05:37.063ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
3812024-08-28T04:05:37.063ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
3822024-08-28T04:05:37.063ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 03:55:37.063389256 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
3832024-08-28T04:05:37.063ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3842024-08-28T04:05:37.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3852024-08-28T04:05:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3862024-08-28T04:05:37.064ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
3872024-08-28T04:05:37.064ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3882024-08-28T04:05:37.064ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
3892024-08-28T04:05:37.064ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
3902024-08-28T04:05:37.064ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
3912024-08-28T04:05:37.064ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3922024-08-28T04:05:37.064ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3932024-08-28T04:05:37.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3942024-08-28T04:05:37.064ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
3952024-08-28T04:05:37.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
3962024-08-28T04:05:37.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
3972024-08-28T04:05:37.066ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
3982024-08-28T04:05:37.066ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
3992024-08-28T04:05:37.066ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:71 reason = no blueprint
4002024-08-28T04:05:37.066ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4012024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 74.922\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4022024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 82.282\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4032024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4042024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
4052024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
4062024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4072024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
4082024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
4092024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4102024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4112024-08-28T04:05:37.067ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4122024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4132024-08-28T04:05:37.067ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4142024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4152024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
4162024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4172024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4182024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4192024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4202024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.077712ms iteration = 1 status = {"error":"no config nor servers"}
4212024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4222024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4232024-08-28T04:05:37.067ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4242024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4252024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 1.152434ms iteration = 1 status = {"error":"no config nor servers"}
4262024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4272024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4282024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4292024-08-28T04:05:37.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4302024-08-28T04:05:37.067ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("037b07ce-9e39-4982-8c20-c4c38f448b97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4e2ba65e-422a-4b1e-b0e3-85f8149a979a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1024, tv_nsec: 148648109 } })
4312024-08-28T04:05:37.070ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4322024-08-28T04:05:37.074ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4332024-08-28T04:05:37.076ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4342024-08-28T04:05:37.077ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4352024-08-28T04:05:37.077ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4362024-08-28T04:05:37.077ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4372024-08-28T04:05:37.078ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4382024-08-28T04:05:37.078ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 15.102343ms iteration = 1 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
4392024-08-28T04:05:37.078ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
4402024-08-28T04:05:37.078ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4412024-08-28T04:05:37.078ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 6.67\u{b5}s iteration = 2 status = {"error":"no config"}
4422024-08-28T04:05:37.079ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4432024-08-28T04:05:37.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4442024-08-28T04:05:37.079ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4452024-08-28T04:05:37.079ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4462024-08-28T04:05:37.079ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4472024-08-28T04:05:37.079ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4482024-08-28T04:05:37.079ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4492024-08-28T04:05:37.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4502024-08-28T04:05:37.079ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4512024-08-28T04:05:37.079ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
4522024-08-28T04:05:37.079ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4532024-08-28T04:05:37.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4542024-08-28T04:05:37.080ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4eb364e4-14a2-46c4-b173-eb2890920e8f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1024, tv_nsec: 161535608 } })
4552024-08-28T04:05:37.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4562024-08-28T04:05:37.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4572024-08-28T04:05:37.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4582024-08-28T04:05:37.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4592024-08-28T04:05:37.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4602024-08-28T04:05:37.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4612024-08-28T04:05:37.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4622024-08-28T04:05:37.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4632024-08-28T04:05:37.082ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
4642024-08-28T04:05:37.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4652024-08-28T04:05:37.082ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4662024-08-28T04:05:37.082ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 19.154652ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
4672024-08-28T04:05:37.082ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
4682024-08-28T04:05:37.082ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4692024-08-28T04:05:37.082ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 3.75\u{b5}s iteration = 2 status = {"error":"no config"}
4702024-08-28T04:05:37.083ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4712024-08-28T04:05:37.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4722024-08-28T04:05:37.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4732024-08-28T04:05:37.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4742024-08-28T04:05:37.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4752024-08-28T04:05:37.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4762024-08-28T04:05:37.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4772024-08-28T04:05:37.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4782024-08-28T04:05:37.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4792024-08-28T04:05:37.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4802024-08-28T04:05:37.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4812024-08-28T04:05:37.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4822024-08-28T04:05:37.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4832024-08-28T04:05:37.086ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 23.727757ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4842024-08-28T04:05:37.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
4852024-08-28T04:05:37.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4862024-08-28T04:05:37.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4872024-08-28T04:05:37.094ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1024, tv_nsec: 175932851 } })
4882024-08-28T04:05:37.095ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1024, tv_nsec: 176242970 } })
4892024-08-28T04:05:37.095ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4902024-08-28T04:05:37.096ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 03:55:37.063389256 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
4912024-08-28T04:05:37.096ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 32.818774ms iteration = 1 status = {"expiration":"2024-08-28T03:55:37.063389256Z","pruned":[]}
4922024-08-28T04:05:37.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
4932024-08-28T04:05:37.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
4942024-08-28T04:05:37.098ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4952024-08-28T04:05:37.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4962024-08-28T04:05:37.099ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
4972024-08-28T04:05:37.100ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4982024-08-28T04:05:37.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4992024-08-28T04:05:37.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5002024-08-28T04:05:37.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5012024-08-28T04:05:37.103ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 40.306114ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5022024-08-28T04:05:37.106ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5032024-08-28T04:05:37.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5042024-08-28T04:05:37.109ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5052024-08-28T04:05:37.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5062024-08-28T04:05:37.113ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 50.694559ms iteration = 1 status = {}
5072024-08-28T04:05:37.116ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5082024-08-28T04:05:37.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5092024-08-28T04:05:37.149ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 86.201352ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
5102024-08-28T04:05:37.150ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5112024-08-28T04:05:37.151ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5122024-08-28T04:05:37.154ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5132024-08-28T04:05:37.154ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5142024-08-28T04:05:37.155ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5152024-08-28T04:05:37.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5162024-08-28T04:05:37.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5172024-08-28T04:05:37.156ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5182024-08-28T04:05:37.157ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5192024-08-28T04:05:37.158ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5202024-08-28T04:05:37.159ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5212024-08-28T04:05:37.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5222024-08-28T04:05:37.159ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
5232024-08-28T04:05:37.159ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5242024-08-28T04:05:37.159ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 96.249977ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
5252024-08-28T04:05:37.160ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
5262024-08-28T04:05:37.160ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
5272024-08-28T04:05:37.160ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5282024-08-28T04:05:37.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5292024-08-28T04:05:37.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5302024-08-28T04:05:37.161ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5312024-08-28T04:05:37.161ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5322024-08-28T04:05:37.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5332024-08-28T04:05:37.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5342024-08-28T04:05:37.161ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5352024-08-28T04:05:37.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5362024-08-28T04:05:37.163ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5372024-08-28T04:05:37.163ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5382024-08-28T04:05:37.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5392024-08-28T04:05:37.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5402024-08-28T04:05:37.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5412024-08-28T04:05:37.169ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5422024-08-28T04:05:37.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5432024-08-28T04:05:37.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5442024-08-28T04:05:37.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5452024-08-28T04:05:37.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5462024-08-28T04:05:37.173ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
5472024-08-28T04:05:37.173ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 106.789027ms iteration = 1 status = {"error":"rack not yet initialized: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880"}
5482024-08-28T04:05:37.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5492024-08-28T04:05:37.173ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5502024-08-28T04:05:37.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5512024-08-28T04:05:37.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5522024-08-28T04:05:37.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5532024-08-28T04:05:37.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5542024-08-28T04:05:37.178ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5552024-08-28T04:05:37.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5562024-08-28T04:05:37.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5572024-08-28T04:05:37.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5582024-08-28T04:05:37.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5592024-08-28T04:05:37.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5602024-08-28T04:05:37.179ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5612024-08-28T04:05:37.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5622024-08-28T04:05:37.184ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
5632024-08-28T04:05:37.184ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
5642024-08-28T04:05:37.184ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 120.749737ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
5652024-08-28T04:05:37.184ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5662024-08-28T04:05:37.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5672024-08-28T04:05:37.190ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5682024-08-28T04:05:37.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5692024-08-28T04:05:37.197ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5702024-08-28T04:05:37.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5712024-08-28T04:05:37.198ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5722024-08-28T04:05:37.198ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5732024-08-28T04:05:37.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5742024-08-28T04:05:37.200ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5752024-08-28T04:05:37.200ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5762024-08-28T04:05:37.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5772024-08-28T04:05:37.203ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5782024-08-28T04:05:37.203ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
5792024-08-28T04:05:37.203ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 140.060524ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
5802024-08-28T04:05:37.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5812024-08-28T04:05:37.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5822024-08-28T04:05:37.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5832024-08-28T04:05:37.207ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5842024-08-28T04:05:37.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5852024-08-28T04:05:37.211ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
5862024-08-28T04:05:37.211ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 147.983977ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
5872024-08-28T04:05:37.218ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
5882024-08-28T04:05:37.218ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
5892024-08-28T04:05:37.218ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 155.026844ms iteration = 1 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
5902024-08-28T04:05:37.220ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
5912024-08-28T04:05:37.220ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
5922024-08-28T04:05:37.220ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 156.687982ms iteration = 1 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
5932024-08-28T04:05:37.223ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
5942024-08-28T04:05:37.223ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5952024-08-28T04:05:37.223ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fb31eb72-e7ac-412a-afff-be7865cab045", "content-length": "26", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
5962024-08-28T04:05:37.224ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
5972024-08-28T04:05:37.224ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 161.36207ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
5982024-08-28T04:05:37.226ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5992024-08-28T04:05:37.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6002024-08-28T04:05:37.228ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
6012024-08-28T04:05:37.228ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6022024-08-28T04:05:37.228ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3d79a237-81b3-49b3-afa4-5c618ad015d8", "content-length": "26", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
6032024-08-28T04:05:37.228ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6042024-08-28T04:05:37.228ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6052024-08-28T04:05:37.230ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6062024-08-28T04:05:37.230ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6072024-08-28T04:05:37.235ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6082024-08-28T04:05:37.235ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 172.27597ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6092024-08-28T04:05:37.238ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(f2e305be-9263-4cf5-9159-57a290d589de, 0)]
6102024-08-28T04:05:37.239ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1024, tv_nsec: 320985811 } })
6112024-08-28T04:05:37.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 179.820062ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6122024-08-28T04:05:37.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 181.607384ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6132024-08-28T04:05:37.251ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
6142024-08-28T04:05:37.251ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 187.831717ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6152024-08-28T04:05:37.251ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6162024-08-28T04:05:37.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6172024-08-28T04:05:37.256ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6182024-08-28T04:05:37.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6192024-08-28T04:05:37.257ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6202024-08-28T04:05:37.257ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 194.168294ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6212024-08-28T04:05:37.258ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6222024-08-28T04:05:37.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6232024-08-28T04:05:37.260ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6242024-08-28T04:05:37.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6252024-08-28T04:05:37.262ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6262024-08-28T04:05:37.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6272024-08-28T04:05:37.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6282024-08-28T04:05:37.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6292024-08-28T04:05:37.265ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6302024-08-28T04:05:37.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6312024-08-28T04:05:37.267ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6322024-08-28T04:05:37.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6332024-08-28T04:05:37.268ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 205.477495ms iteration = 1 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
6342024-08-28T04:05:37.269ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6352024-08-28T04:05:37.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6362024-08-28T04:05:37.273ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6372024-08-28T04:05:37.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6382024-08-28T04:05:37.274ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6392024-08-28T04:05:37.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6402024-08-28T04:05:37.276ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6412024-08-28T04:05:37.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6422024-08-28T04:05:37.277ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 214.350047ms iteration = 1 status = {}
6432024-08-28T04:05:37.278ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6442024-08-28T04:05:37.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6452024-08-28T04:05:37.281ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6462024-08-28T04:05:37.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6472024-08-28T04:05:37.282ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6482024-08-28T04:05:37.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6492024-08-28T04:05:37.283ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6502024-08-28T04:05:37.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6512024-08-28T04:05:37.284ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6522024-08-28T04:05:37.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6532024-08-28T04:05:37.285ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6542024-08-28T04:05:37.289ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
6552024-08-28T04:05:37.289ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6562024-08-28T04:05:37.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6572024-08-28T04:05:37.291ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6582024-08-28T04:05:37.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6592024-08-28T04:05:37.292ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6602024-08-28T04:05:37.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6612024-08-28T04:05:37.295ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6622024-08-28T04:05:37.298ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
6632024-08-28T04:05:37.298ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6642024-08-28T04:05:37.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6652024-08-28T04:05:37.312ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6662024-08-28T04:05:37.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6672024-08-28T04:05:37.313ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6682024-08-28T04:05:37.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6692024-08-28T04:05:37.314ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 251.428465ms iteration = 1 status = {}
6702024-08-28T04:05:37.317ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6712024-08-28T04:05:37.317ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "096337c1-f80b-4b1e-8005-c76ecead20e9", "content-length": "1", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
6722024-08-28T04:05:37.319ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6732024-08-28T04:05:37.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6742024-08-28T04:05:37.319ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6752024-08-28T04:05:37.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6762024-08-28T04:05:37.321ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6772024-08-28T04:05:37.321ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 258.691548ms iteration = 1 status = null
6782024-08-28T04:05:37.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6792024-08-28T04:05:37.326ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6802024-08-28T04:05:37.326ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6812024-08-28T04:05:37.326ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6822024-08-28T04:05:37.327ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/ignition", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1ffe7061-bfa3-4c08-8a0f-2934cfab833d", "content-length": "476", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
6832024-08-28T04:05:37.328ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6842024-08-28T04:05:37.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6852024-08-28T04:05:37.329ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6862024-08-28T04:05:37.329ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1b8473f7-ef12-46f0-ad24-655c720a20ea", "content-length": "734", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
6872024-08-28T04:05:37.329ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6882024-08-28T04:05:37.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6892024-08-28T04:05:37.331ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6902024-08-28T04:05:37.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6912024-08-28T04:05:37.331ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6922024-08-28T04:05:37.332ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "02bd31e7-b8f8-41f3-952e-6c708641c837", "content-length": "86", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
6932024-08-28T04:05:37.332ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6942024-08-28T04:05:37.333ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6952024-08-28T04:05:37.335ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "78a9c439-fa0d-4548-89ed-73edcf350a2c", "content-length": "86", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
6962024-08-28T04:05:37.335ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6972024-08-28T04:05:37.335ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "55f8d685-2d67-4b34-8eca-4e807046ae9f", "content-length": "80", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
6982024-08-28T04:05:37.335ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6992024-08-28T04:05:37.335ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8c4dd24c-7bf2-4937-9558-f265b758cd17", "content-length": "80", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7002024-08-28T04:05:37.335ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
7012024-08-28T04:05:37.336ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "649d98c5-8329-4e1a-aaf7-951fa6e56521", "content-length": "88", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7022024-08-28T04:05:37.336ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
7032024-08-28T04:05:37.336ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7042024-08-28T04:05:37.336ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7052024-08-28T04:05:37.336ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8f96328b-170a-4365-bce3-b999b2e675e0", "content-length": "88", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7062024-08-28T04:05:37.336ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
7072024-08-28T04:05:37.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7082024-08-28T04:05:37.336ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1130ab42-422d-42d8-b5f9-50f7613374c4", "content-length": "702", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7092024-08-28T04:05:37.337ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7102024-08-28T04:05:37.337ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c8064d5a-e53c-4222-b07a-87330c9bb59a", "content-length": "727", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7112024-08-28T04:05:37.338ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7122024-08-28T04:05:37.338ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7132024-08-28T04:05:37.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7142024-08-28T04:05:37.338ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6a3c0bc9-9a93-45b0-bafa-919eae2dbe0d", "content-length": "729", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7152024-08-28T04:05:37.338ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7162024-08-28T04:05:37.339ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "56c92879-d773-4629-939e-d8bec23ae778", "content-length": "728", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7172024-08-28T04:05:37.339ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
7182024-08-28T04:05:37.339ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a5218713-461f-4012-b236-d9677ac38030", "content-length": "722", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7192024-08-28T04:05:37.339ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
7202024-08-28T04:05:37.339ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "403cb098-c896-43e1-9c6b-b113cce969a5", "content-length": "84", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7212024-08-28T04:05:37.339ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
7222024-08-28T04:05:37.339ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6bdbb937-1415-4b25-8957-595d76a8698d", "content-length": "84", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7232024-08-28T04:05:37.339ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
7242024-08-28T04:05:37.341ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dbacdf97-3bfd-4ab4-aa03-04026c042fe4", "content-length": "82", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7252024-08-28T04:05:37.341ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
7262024-08-28T04:05:37.341ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "89011399-9993-466a-82b5-6321cd5d0d30", "content-length": "82", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7272024-08-28T04:05:37.341ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
7282024-08-28T04:05:37.341ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "04496bd5-b131-44f5-bd78-b3e5bb6a281a", "content-length": "91", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7292024-08-28T04:05:37.341ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
7302024-08-28T04:05:37.342ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e74a0842-4fef-452b-978c-c0436b772e45", "content-length": "91", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7312024-08-28T04:05:37.342ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
7322024-08-28T04:05:37.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7332024-08-28T04:05:37.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7342024-08-28T04:05:37.342ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "59fc8ae8-dbd5-491d-b87d-300fa9eeb01a", "content-length": "702", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7352024-08-28T04:05:37.342ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7362024-08-28T04:05:37.343ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d9791045-2768-4207-a63a-3e1658556b9b", "content-length": "727", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7372024-08-28T04:05:37.343ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7382024-08-28T04:05:37.343ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7b54cc77-a7e7-4463-b7cc-c8fa5e5ad80f", "content-length": "729", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7392024-08-28T04:05:37.343ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7402024-08-28T04:05:37.343ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "47704131-0bac-44e5-91d0-ba71fe3f9f8a", "content-length": "728", "date": "Wed, 28 Aug 2024 04:05:36 GMT"} })
7412024-08-28T04:05:37.343ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7422024-08-28T04:05:37.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7432024-08-28T04:05:37.343ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7442024-08-28T04:05:37.344ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7452024-08-28T04:05:37.347ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7462024-08-28T04:05:37.347ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7472024-08-28T04:05:37.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7482024-08-28T04:05:37.347ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7492024-08-28T04:05:37.347ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7502024-08-28T04:05:37.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7512024-08-28T04:05:37.348ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7522024-08-28T04:05:37.350ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7532024-08-28T04:05:37.350ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7542024-08-28T04:05:37.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7552024-08-28T04:05:37.359ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
7562024-08-28T04:05:37.359ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7572024-08-28T04:05:37.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7582024-08-28T04:05:37.361ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7592024-08-28T04:05:37.362ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
7602024-08-28T04:05:37.362ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7612024-08-28T04:05:37.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7622024-08-28T04:05:37.378ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
7632024-08-28T04:05:37.378ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
7642024-08-28T04:05:37.378ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
7652024-08-28T04:05:37.383ZERROnexus (BackgroundTasks): nexus is running but no service zone nat values could be generated from inventory background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:257
7662024-08-28T04:05:37.383ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 320.148754ms iteration = 1 status = {"error":"nexus is running but no service zone nat values could be generated from inventory"}
7672024-08-28T04:05:37.393ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7682024-08-28T04:05:37.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7692024-08-28T04:05:37.395ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7702024-08-28T04:05:37.397ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7712024-08-28T04:05:37.397ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7722024-08-28T04:05:37.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7732024-08-28T04:05:37.399ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7742024-08-28T04:05:37.400ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7752024-08-28T04:05:37.400ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7762024-08-28T04:05:37.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7772024-08-28T04:05:37.412ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
7782024-08-28T04:05:37.412ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7792024-08-28T04:05:37.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7802024-08-28T04:05:37.414ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7812024-08-28T04:05:37.416ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7822024-08-28T04:05:37.417ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7832024-08-28T04:05:37.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7842024-08-28T04:05:37.432ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:48528
7852024-08-28T04:05:37.437ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
7862024-08-28T04:05:37.438ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
7872024-08-28T04:05:37.438ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
7882024-08-28T04:05:37.438ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 373.910073ms
7892024-08-28T04:05:37.438ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 374.82384ms iteration = 1 status = {}
7902024-08-28T04:05:37.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:48528 req_id = 8756f811-eab4-4679-9024-cd56e9eed90b roles = RoleSet { roles: {} } uri = /metrics/collectors
7912024-08-28T04:05:37.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:48528 req_id = 8756f811-eab4-4679-9024-cd56e9eed90b resource = Database result = Ok(()) uri = /metrics/collectors
7922024-08-28T04:05:37.457ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 393.787277ms iteration = 1 status = {}
7932024-08-28T04:05:37.478ZINFOnexus: registered new oximeter metric collection server address = [fd00:1122:3344:101::d]:12223 collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:88
7942024-08-28T04:05:37.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 46898 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:48528 req_id = 8756f811-eab4-4679-9024-cd56e9eed90b response_code = 204 uri = /metrics/collectors
7952024-08-28T04:05:37.520ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:43006
7962024-08-28T04:05:37.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43006 req_id = 63bcb3e9-d0ea-4973-be5f-5d245ae1423d roles = RoleSet { roles: {} } uri = /metrics/collectors/21378de4-15c3-48e2-b919-b1cc2363c4a6/producers?sort_by=id_ascending
7972024-08-28T04:05:37.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43006 req_id = 63bcb3e9-d0ea-4973-be5f-5d245ae1423d resource = Database result = Ok(()) uri = /metrics/collectors/21378de4-15c3-48e2-b919-b1cc2363c4a6/producers?sort_by=id_ascending
7982024-08-28T04:05:37.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43006 req_id = 63bcb3e9-d0ea-4973-be5f-5d245ae1423d response_code = 200 uri = /metrics/collectors/21378de4-15c3-48e2-b919-b1cc2363c4a6/producers?sort_by=id_ascending
7992024-08-28T04:05:37.529ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = a6de3f37-8ce3-40a7-80bf-299648918d43 file = nexus/db-queries/src/db/datastore/inventory.rs:893
8002024-08-28T04:05:37.530ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = a6de3f37-8ce3-40a7-80bf-299648918d43 time_started = 2024-08-28 04:05:37.325351 UTC
8012024-08-28T04:05:37.530ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 464.625668ms iteration = 1 status = {"collection_id":"a6de3f37-8ce3-40a7-80bf-299648918d43","time_done":"2024-08-28 04:05:37.412531 UTC","time_started":"2024-08-28 04:05:37.325351 UTC"}
8022024-08-28T04:05:37.530ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
8032024-08-28T04:05:37.530ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8042024-08-28T04:05:37.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8052024-08-28T04:05:37.532ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8062024-08-28T04:05:37.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8072024-08-28T04:05:37.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8082024-08-28T04:05:37.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8092024-08-28T04:05:37.536ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
8102024-08-28T04:05:37.536ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.741269ms iteration = 2 status = {"error":"rack not yet initialized: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880"}
8112024-08-28T04:05:37.723ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:33295
8122024-08-28T04:05:37.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8132024-08-28T04:05:37.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8142024-08-28T04:05:37.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8152024-08-28T04:05:37.730ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8162024-08-28T04:05:37.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8172024-08-28T04:05:37.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8182024-08-28T04:05:37.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8192024-08-28T04:05:37.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8202024-08-28T04:05:37.780ZINFOnexus (dropshot_internal): set cockroachdb setting actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:124 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 setting = cluster.preserve_downgrade_option uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete value = 22.1
8212024-08-28T04:05:37.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8222024-08-28T04:05:37.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8232024-08-28T04:05:37.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8242024-08-28T04:05:37.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8252024-08-28T04:05:37.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8262024-08-28T04:05:37.787ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Rack { parent: Fleet, key: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, lookup_type: ById(8b05f6f6-ff29-4d8c-aa09-514d34e6a880) } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8272024-08-28T04:05:37.787ZDEBGnexus (dropshot_internal): updating rack subnet for rack 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8282024-08-28T04:05:37.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8292024-08-28T04:05:37.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8302024-08-28T04:05:37.794ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8312024-08-28T04:05:37.824ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8322024-08-28T04:05:37.827ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/ports", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c5960d2f-0b6a-45ad-9233-20a512a93a5c", "content-length": "24", "date": "Wed, 28 Aug 2024 04:05:37 GMT"} }) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8332024-08-28T04:05:37.829ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8342024-08-28T04:05:37.829ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8352024-08-28T04:05:37.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8362024-08-28T04:05:37.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8372024-08-28T04:05:37.851ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8382024-08-28T04:05:37.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8392024-08-28T04:05:37.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8402024-08-28T04:05:37.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8412024-08-28T04:05:37.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8422024-08-28T04:05:38.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8432024-08-28T04:05:38.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8442024-08-28T04:05:38.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8452024-08-28T04:05:38.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8462024-08-28T04:05:38.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8472024-08-28T04:05:38.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8482024-08-28T04:05:38.057ZERROnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound file = nexus/db-queries/src/db/datastore/switch_port.rs:890 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8492024-08-28T04:05:38.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8502024-08-28T04:05:38.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8512024-08-28T04:05:38.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8522024-08-28T04:05:38.065ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8532024-08-28T04:05:38.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8542024-08-28T04:05:38.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8552024-08-28T04:05:38.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8562024-08-28T04:05:38.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8572024-08-28T04:05:38.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8582024-08-28T04:05:38.071ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = IpPool { parent: Fleet, key: d3abad20-cbd5-40ac-bbf7-81eb439b639b, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8592024-08-28T04:05:38.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8602024-08-28T04:05:38.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8612024-08-28T04:05:38.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8622024-08-28T04:05:38.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8632024-08-28T04:05:38.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8642024-08-28T04:05:38.076ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = IpPool { parent: Fleet, key: d3abad20-cbd5-40ac-bbf7-81eb439b639b, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8652024-08-28T04:05:38.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8662024-08-28T04:05:38.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8672024-08-28T04:05:38.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8682024-08-28T04:05:38.100ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = BlueprintConfig result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8692024-08-28T04:05:38.197ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 file = nexus/db-queries/src/db/datastore/deployment.rs:266 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8702024-08-28T04:05:38.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8712024-08-28T04:05:38.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8722024-08-28T04:05:38.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8732024-08-28T04:05:38.200ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = BlueprintConfig result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8742024-08-28T04:05:38.205ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8752024-08-28T04:05:38.205ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8762024-08-28T04:05:38.205ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8772024-08-28T04:05:38.205ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8782024-08-28T04:05:38.205ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8792024-08-28T04:05:38.206ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8802024-08-28T04:05:38.206ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8812024-08-28T04:05:38.206ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8822024-08-28T04:05:38.293ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8832024-08-28T04:05:38.316ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8842024-08-28T04:05:38.338ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8852024-08-28T04:05:38.358ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8862024-08-28T04:05:38.385ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8872024-08-28T04:05:38.385ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8882024-08-28T04:05:38.385ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8892024-08-28T04:05:38.385ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8902024-08-28T04:05:38.385ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8912024-08-28T04:05:38.385ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8922024-08-28T04:05:38.385ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8932024-08-28T04:05:38.385ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8942024-08-28T04:05:38.385ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8952024-08-28T04:05:38.385ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8962024-08-28T04:05:38.385ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8972024-08-28T04:05:38.385ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8982024-08-28T04:05:38.385ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
8992024-08-28T04:05:38.385ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9002024-08-28T04:05:38.385ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9012024-08-28T04:05:38.411ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9022024-08-28T04:05:38.411ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9032024-08-28T04:05:38.411ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: ddad7798-b711-4a2c-b699-d85c5bf35100, time_created: 2024-08-28T04:05:37.730614865Z, time_modified: 2024-08-28T04:05:37.730614865Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9042024-08-28T04:05:38.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9052024-08-28T04:05:38.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9062024-08-28T04:05:38.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9072024-08-28T04:05:38.415ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9082024-08-28T04:05:38.431ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9092024-08-28T04:05:38.434ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "f62e5a13-51f3-4379-acf3-2f8e8601ac1f" error_message_internal = not found: sled with id "f62e5a13-51f3-4379-acf3-2f8e8601ac1f" file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 710235 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = f82edf30-4a79-4bee-a9cd-84139c6b3f10 response_code = 404 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9102024-08-28T04:05:38.493ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9112024-08-28T04:05:38.494ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9122024-08-28T04:05:38.495ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9132024-08-28T04:05:38.495ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9142024-08-28T04:05:38.496ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9152024-08-28T04:05:38.499ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, lookup_type: ById(8b05f6f6-ff29-4d8c-aa09-514d34e6a880) } result = Ok(())
9162024-08-28T04:05:38.499ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, time_created: 2024-08-28T04:05:36.972220Z, time_modified: 2024-08-28T04:05:36.972220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
9172024-08-28T04:05:40.501ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9182024-08-28T04:05:40.501ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9192024-08-28T04:05:40.503ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9202024-08-28T04:05:40.503ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9212024-08-28T04:05:40.504ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9222024-08-28T04:05:40.507ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, lookup_type: ById(8b05f6f6-ff29-4d8c-aa09-514d34e6a880) } result = Ok(())
9232024-08-28T04:05:40.507ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, time_created: 2024-08-28T04:05:36.972220Z, time_modified: 2024-08-28T04:05:36.972220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
9242024-08-28T04:05:42.507ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9252024-08-28T04:05:42.507ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9262024-08-28T04:05:42.509ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9272024-08-28T04:05:42.509ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9282024-08-28T04:05:42.510ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9292024-08-28T04:05:42.513ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, lookup_type: ById(8b05f6f6-ff29-4d8c-aa09-514d34e6a880) } result = Ok(())
9302024-08-28T04:05:42.513ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, time_created: 2024-08-28T04:05:36.972220Z, time_modified: 2024-08-28T04:05:36.972220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
9312024-08-28T04:05:43.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9322024-08-28T04:05:43.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9332024-08-28T04:05:43.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9342024-08-28T04:05:43.483ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9352024-08-28T04:05:43.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9362024-08-28T04:05:43.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9372024-08-28T04:05:43.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9382024-08-28T04:05:43.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9392024-08-28T04:05:43.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9402024-08-28T04:05:43.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9412024-08-28T04:05:43.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9422024-08-28T04:05:43.504ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Rack { parent: Fleet, key: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, lookup_type: ById(8b05f6f6-ff29-4d8c-aa09-514d34e6a880) } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9432024-08-28T04:05:43.504ZDEBGnexus (dropshot_internal): updating rack subnet for rack 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9442024-08-28T04:05:43.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9452024-08-28T04:05:43.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9462024-08-28T04:05:43.508ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9472024-08-28T04:05:43.540ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9482024-08-28T04:05:43.540ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/ports", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0a58c85c-8289-4f1c-ba18-ea2ee2f21e4f", "content-length": "24", "date": "Wed, 28 Aug 2024 04:05:43 GMT"} }) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9492024-08-28T04:05:43.540ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9502024-08-28T04:05:43.540ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9512024-08-28T04:05:43.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9522024-08-28T04:05:43.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9532024-08-28T04:05:43.551ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9542024-08-28T04:05:43.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9552024-08-28T04:05:43.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9562024-08-28T04:05:43.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9572024-08-28T04:05:43.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9582024-08-28T04:05:43.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9592024-08-28T04:05:43.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9602024-08-28T04:05:43.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9612024-08-28T04:05:43.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9622024-08-28T04:05:43.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9632024-08-28T04:05:43.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9642024-08-28T04:05:43.562ZERROnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound file = nexus/db-queries/src/db/datastore/switch_port.rs:890 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9652024-08-28T04:05:43.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9662024-08-28T04:05:43.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9672024-08-28T04:05:43.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9682024-08-28T04:05:43.566ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9692024-08-28T04:05:43.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9702024-08-28T04:05:43.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9712024-08-28T04:05:43.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9722024-08-28T04:05:43.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9732024-08-28T04:05:43.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9742024-08-28T04:05:43.572ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = IpPool { parent: Fleet, key: d3abad20-cbd5-40ac-bbf7-81eb439b639b, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9752024-08-28T04:05:43.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9762024-08-28T04:05:43.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9772024-08-28T04:05:43.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9782024-08-28T04:05:43.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9792024-08-28T04:05:43.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9802024-08-28T04:05:43.576ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = IpPool { parent: Fleet, key: d3abad20-cbd5-40ac-bbf7-81eb439b639b, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9812024-08-28T04:05:43.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9822024-08-28T04:05:43.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9832024-08-28T04:05:43.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9842024-08-28T04:05:43.585ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = BlueprintConfig result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9852024-08-28T04:05:43.594ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 file = nexus/db-queries/src/db/datastore/deployment.rs:266 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9862024-08-28T04:05:43.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9872024-08-28T04:05:43.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9882024-08-28T04:05:43.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9892024-08-28T04:05:43.597ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = BlueprintConfig result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9902024-08-28T04:05:43.601ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9912024-08-28T04:05:43.601ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9922024-08-28T04:05:43.601ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9932024-08-28T04:05:43.601ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9942024-08-28T04:05:43.601ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9952024-08-28T04:05:43.601ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9962024-08-28T04:05:43.601ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9972024-08-28T04:05:43.601ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9982024-08-28T04:05:43.622ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
9992024-08-28T04:05:43.644ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10002024-08-28T04:05:43.666ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10012024-08-28T04:05:43.689ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10022024-08-28T04:05:43.710ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10032024-08-28T04:05:43.710ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10042024-08-28T04:05:43.710ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10052024-08-28T04:05:43.710ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10062024-08-28T04:05:43.710ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10072024-08-28T04:05:43.710ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10082024-08-28T04:05:43.710ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10092024-08-28T04:05:43.710ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10102024-08-28T04:05:43.710ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10112024-08-28T04:05:43.710ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10122024-08-28T04:05:43.710ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10132024-08-28T04:05:43.710ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10142024-08-28T04:05:43.710ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10152024-08-28T04:05:43.710ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10162024-08-28T04:05:43.710ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10172024-08-28T04:05:43.739ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10182024-08-28T04:05:43.739ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10192024-08-28T04:05:43.739ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: ddad7798-b711-4a2c-b699-d85c5bf35100, time_created: 2024-08-28T04:05:43.483116315Z, time_modified: 2024-08-28T04:05:43.483116315Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10202024-08-28T04:05:43.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10212024-08-28T04:05:43.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10222024-08-28T04:05:43.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10232024-08-28T04:05:43.743ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10242024-08-28T04:05:43.746ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10252024-08-28T04:05:43.749ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "f62e5a13-51f3-4379-acf3-2f8e8601ac1f" error_message_internal = not found: sled with id "f62e5a13-51f3-4379-acf3-2f8e8601ac1f" file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 269765 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 127d7530-18eb-4855-918b-250e322e5c6e response_code = 404 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10262024-08-28T04:05:44.514ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10272024-08-28T04:05:44.514ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10282024-08-28T04:05:44.515ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10292024-08-28T04:05:44.516ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10302024-08-28T04:05:44.517ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10312024-08-28T04:05:44.520ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, lookup_type: ById(8b05f6f6-ff29-4d8c-aa09-514d34e6a880) } result = Ok(())
10322024-08-28T04:05:44.520ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, time_created: 2024-08-28T04:05:36.972220Z, time_modified: 2024-08-28T04:05:36.972220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
10332024-08-28T04:05:46.521ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10342024-08-28T04:05:46.521ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10352024-08-28T04:05:46.522ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10362024-08-28T04:05:46.522ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10372024-08-28T04:05:46.524ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10382024-08-28T04:05:46.526ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, lookup_type: ById(8b05f6f6-ff29-4d8c-aa09-514d34e6a880) } result = Ok(())
10392024-08-28T04:05:46.526ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, time_created: 2024-08-28T04:05:36.972220Z, time_modified: 2024-08-28T04:05:36.972220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
10402024-08-28T04:05:47.063ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
10412024-08-28T04:05:47.063ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
10422024-08-28T04:05:47.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10432024-08-28T04:05:47.063ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10442024-08-28T04:05:47.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10452024-08-28T04:05:47.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10462024-08-28T04:05:47.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10472024-08-28T04:05:47.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10482024-08-28T04:05:47.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10492024-08-28T04:05:47.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10502024-08-28T04:05:47.071ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
10512024-08-28T04:05:47.071ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 7.204112ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
10522024-08-28T04:05:47.094ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10532024-08-28T04:05:47.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10542024-08-28T04:05:47.118ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.117069ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10552024-08-28T04:05:48.527ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10562024-08-28T04:05:48.528ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10572024-08-28T04:05:48.529ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10582024-08-28T04:05:48.529ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10592024-08-28T04:05:48.531ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10602024-08-28T04:05:48.533ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, lookup_type: ById(8b05f6f6-ff29-4d8c-aa09-514d34e6a880) } result = Ok(())
10612024-08-28T04:05:48.533ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, time_created: 2024-08-28T04:05:36.972220Z, time_modified: 2024-08-28T04:05:36.972220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
10622024-08-28T04:05:49.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10632024-08-28T04:05:49.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10642024-08-28T04:05:49.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10652024-08-28T04:05:49.286ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10662024-08-28T04:05:49.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10672024-08-28T04:05:49.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10682024-08-28T04:05:49.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10692024-08-28T04:05:49.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10702024-08-28T04:05:49.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10712024-08-28T04:05:49.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10722024-08-28T04:05:49.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10732024-08-28T04:05:49.295ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Rack { parent: Fleet, key: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, lookup_type: ById(8b05f6f6-ff29-4d8c-aa09-514d34e6a880) } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10742024-08-28T04:05:49.295ZDEBGnexus (dropshot_internal): updating rack subnet for rack 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10752024-08-28T04:05:49.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10762024-08-28T04:05:49.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10772024-08-28T04:05:49.301ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10782024-08-28T04:05:49.333ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10792024-08-28T04:05:49.333ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/ports", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "449b530a-7665-4618-9d10-7372a891853c", "content-length": "24", "date": "Wed, 28 Aug 2024 04:05:48 GMT"} }) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10802024-08-28T04:05:49.333ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10812024-08-28T04:05:49.333ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10822024-08-28T04:05:49.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10832024-08-28T04:05:49.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10842024-08-28T04:05:49.349ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10852024-08-28T04:05:49.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10862024-08-28T04:05:49.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10872024-08-28T04:05:49.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10882024-08-28T04:05:49.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10892024-08-28T04:05:49.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10902024-08-28T04:05:49.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10912024-08-28T04:05:49.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10922024-08-28T04:05:49.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10932024-08-28T04:05:49.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10942024-08-28T04:05:49.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10952024-08-28T04:05:49.404ZERROnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound file = nexus/db-queries/src/db/datastore/switch_port.rs:890 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10962024-08-28T04:05:49.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10972024-08-28T04:05:49.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10982024-08-28T04:05:49.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
10992024-08-28T04:05:49.409ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11002024-08-28T04:05:49.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11012024-08-28T04:05:49.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11022024-08-28T04:05:49.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11032024-08-28T04:05:49.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11042024-08-28T04:05:49.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11052024-08-28T04:05:49.415ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = IpPool { parent: Fleet, key: d3abad20-cbd5-40ac-bbf7-81eb439b639b, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11062024-08-28T04:05:49.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11072024-08-28T04:05:49.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11082024-08-28T04:05:49.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11092024-08-28T04:05:49.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11102024-08-28T04:05:49.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11112024-08-28T04:05:49.419ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = IpPool { parent: Fleet, key: d3abad20-cbd5-40ac-bbf7-81eb439b639b, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11122024-08-28T04:05:49.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11132024-08-28T04:05:49.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11142024-08-28T04:05:49.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11152024-08-28T04:05:49.447ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = BlueprintConfig result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11162024-08-28T04:05:49.558ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 file = nexus/db-queries/src/db/datastore/deployment.rs:266 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11172024-08-28T04:05:49.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11182024-08-28T04:05:49.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11192024-08-28T04:05:49.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11202024-08-28T04:05:49.561ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = BlueprintConfig result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11212024-08-28T04:05:49.581ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11222024-08-28T04:05:49.581ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11232024-08-28T04:05:49.581ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11242024-08-28T04:05:49.581ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11252024-08-28T04:05:49.581ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11262024-08-28T04:05:49.581ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11272024-08-28T04:05:49.581ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11282024-08-28T04:05:49.581ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11292024-08-28T04:05:49.686ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11302024-08-28T04:05:49.715ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11312024-08-28T04:05:49.736ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11322024-08-28T04:05:49.767ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11332024-08-28T04:05:49.788ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11342024-08-28T04:05:49.788ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11352024-08-28T04:05:49.788ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11362024-08-28T04:05:49.788ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11372024-08-28T04:05:49.788ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11382024-08-28T04:05:49.788ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11392024-08-28T04:05:49.788ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11402024-08-28T04:05:49.788ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11412024-08-28T04:05:49.788ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11422024-08-28T04:05:49.788ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11432024-08-28T04:05:49.788ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11442024-08-28T04:05:49.788ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11452024-08-28T04:05:49.788ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11462024-08-28T04:05:49.788ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11472024-08-28T04:05:49.788ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11482024-08-28T04:05:49.814ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11492024-08-28T04:05:49.814ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11502024-08-28T04:05:49.814ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: ddad7798-b711-4a2c-b699-d85c5bf35100, time_created: 2024-08-28T04:05:49.286944772Z, time_modified: 2024-08-28T04:05:49.286944772Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11512024-08-28T04:05:49.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11522024-08-28T04:05:49.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11532024-08-28T04:05:49.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11542024-08-28T04:05:49.817ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11552024-08-28T04:05:49.837ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 7c93907b-7c58-460d-818e-0ab84547fbad, time_created: 2024-08-28T04:05:49.286945332Z, time_modified: 2024-08-28T04:05:49.286945332Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2", variant: U2, sled_id: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11562024-08-28T04:05:49.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11572024-08-28T04:05:49.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11582024-08-28T04:05:49.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11592024-08-28T04:05:49.841ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11602024-08-28T04:05:49.844ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 91fa6a08-4505-48e2-b5ca-e9d43b2cfd3b, time_created: 2024-08-28T04:05:49.286945462Z, time_modified: 2024-08-28T04:05:49.286945462Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2", variant: U2, sled_id: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11612024-08-28T04:05:49.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11622024-08-28T04:05:49.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11632024-08-28T04:05:49.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11642024-08-28T04:05:49.848ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11652024-08-28T04:05:49.856ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 848e2ed8-0b89-4355-beee-234dd6198a39, time_created: 2024-08-28T04:05:49.286945552Z, time_modified: 2024-08-28T04:05:49.286945552Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2", variant: U2, sled_id: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11662024-08-28T04:05:49.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11672024-08-28T04:05:49.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11682024-08-28T04:05:49.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11692024-08-28T04:05:49.860ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11702024-08-28T04:05:49.864ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 67af7c20-e426-4b0e-bd99-c1f8e00a1155, time_created: 2024-08-28T04:05:49.286945632Z, time_modified: 2024-08-28T04:05:49.286945632Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2", variant: U2, sled_id: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11712024-08-28T04:05:49.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11722024-08-28T04:05:49.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11732024-08-28T04:05:49.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11742024-08-28T04:05:49.867ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11752024-08-28T04:05:49.871ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: e6f0eebf-c766-40d8-8cad-27901b39feb6, time_created: 2024-08-28T04:05:49.286945712Z, time_modified: 2024-08-28T04:05:49.286945712Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2", variant: U2, sled_id: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11762024-08-28T04:05:49.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11772024-08-28T04:05:49.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11782024-08-28T04:05:49.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11792024-08-28T04:05:49.874ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11802024-08-28T04:05:49.878ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 2872258c-56a1-4a3d-84ca-fdc53383ae52, time_created: 2024-08-28T04:05:49.286945782Z, time_modified: 2024-08-28T04:05:49.286945782Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2", variant: U2, sled_id: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11812024-08-28T04:05:49.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11822024-08-28T04:05:49.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11832024-08-28T04:05:49.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11842024-08-28T04:05:49.881ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11852024-08-28T04:05:49.885ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: ed833b22-7b6d-4faa-a6f2-fa2abe2ed3fe, time_created: 2024-08-28T04:05:49.286945862Z, time_modified: 2024-08-28T04:05:49.286945862Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2", variant: U2, sled_id: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11862024-08-28T04:05:49.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11872024-08-28T04:05:49.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11882024-08-28T04:05:49.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11892024-08-28T04:05:49.888ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11902024-08-28T04:05:49.892ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 3419f35d-cfa2-4d4b-b68c-ed68c24cfb91, time_created: 2024-08-28T04:05:49.286945942Z, time_modified: 2024-08-28T04:05:49.286945942Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2", variant: U2, sled_id: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11912024-08-28T04:05:49.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11922024-08-28T04:05:49.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11932024-08-28T04:05:49.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11942024-08-28T04:05:49.895ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11952024-08-28T04:05:49.899ZINFOnexus (dropshot_internal): Inserted physical disks actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:823 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11962024-08-28T04:05:49.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11972024-08-28T04:05:49.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11982024-08-28T04:05:49.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
11992024-08-28T04:05:49.902ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12002024-08-28T04:05:49.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12012024-08-28T04:05:49.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12022024-08-28T04:05:49.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12032024-08-28T04:05:49.911ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12042024-08-28T04:05:49.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12052024-08-28T04:05:49.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12062024-08-28T04:05:49.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12072024-08-28T04:05:49.918ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12082024-08-28T04:05:49.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12092024-08-28T04:05:49.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12102024-08-28T04:05:49.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12112024-08-28T04:05:49.925ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12122024-08-28T04:05:49.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12132024-08-28T04:05:49.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12142024-08-28T04:05:49.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12152024-08-28T04:05:49.932ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12162024-08-28T04:05:49.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12172024-08-28T04:05:49.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12182024-08-28T04:05:49.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12192024-08-28T04:05:49.938ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12202024-08-28T04:05:49.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12212024-08-28T04:05:49.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12222024-08-28T04:05:49.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12232024-08-28T04:05:49.945ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12242024-08-28T04:05:49.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12252024-08-28T04:05:49.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12262024-08-28T04:05:49.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12272024-08-28T04:05:49.952ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12282024-08-28T04:05:49.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12292024-08-28T04:05:49.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12302024-08-28T04:05:49.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12312024-08-28T04:05:49.958ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12322024-08-28T04:05:49.963ZINFOnexus (dropshot_internal): Inserted zpools actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:835 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12332024-08-28T04:05:50.048ZINFOnexus (dropshot_internal): Inserted datasets actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:865 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12342024-08-28T04:05:50.070ZINFOnexus (dropshot_internal): Populated DNS tables for internal DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:876 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12352024-08-28T04:05:50.074ZINFOnexus (dropshot_internal): Populated DNS tables for external DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:885 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12362024-08-28T04:05:50.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12372024-08-28T04:05:50.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12382024-08-28T04:05:50.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12392024-08-28T04:05:50.078ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12402024-08-28T04:05:50.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12412024-08-28T04:05:50.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12422024-08-28T04:05:50.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12432024-08-28T04:05:50.080ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12442024-08-28T04:05:50.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12452024-08-28T04:05:50.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12462024-08-28T04:05:50.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12472024-08-28T04:05:50.122ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = DnsConfig result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12482024-08-28T04:05:50.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12492024-08-28T04:05:50.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12502024-08-28T04:05:50.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12512024-08-28T04:05:50.126ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = DnsConfig result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12522024-08-28T04:05:50.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12532024-08-28T04:05:50.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12542024-08-28T04:05:50.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12552024-08-28T04:05:50.132ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = DnsConfig result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12562024-08-28T04:05:50.145ZINFOnexus (dropshot_internal): Created recovery silo actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:451 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12572024-08-28T04:05:50.156ZINFOnexus (dropshot_internal): Created recovery user actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:467 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12582024-08-28T04:05:50.163ZINFOnexus (dropshot_internal): Created recovery user's password actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:481 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12592024-08-28T04:05:50.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12602024-08-28T04:05:50.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12612024-08-28T04:05:50.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12622024-08-28T04:05:50.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12632024-08-28T04:05:50.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12642024-08-28T04:05:50.167ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12652024-08-28T04:05:50.167ZDEBGnexus (dropshot_internal): Generated role assignment queries actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12662024-08-28T04:05:50.171ZINFOnexus (dropshot_internal): Granted Silo privileges actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:509 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12672024-08-28T04:05:50.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12682024-08-28T04:05:50.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12692024-08-28T04:05:50.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12702024-08-28T04:05:50.176ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12712024-08-28T04:05:50.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12722024-08-28T04:05:50.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12732024-08-28T04:05:50.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12742024-08-28T04:05:50.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12752024-08-28T04:05:50.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12762024-08-28T04:05:50.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12772024-08-28T04:05:50.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12782024-08-28T04:05:50.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12792024-08-28T04:05:50.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12802024-08-28T04:05:50.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12812024-08-28T04:05:50.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12822024-08-28T04:05:50.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12832024-08-28T04:05:50.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12842024-08-28T04:05:50.218ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12852024-08-28T04:05:50.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12862024-08-28T04:05:50.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12872024-08-28T04:05:50.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12882024-08-28T04:05:50.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12892024-08-28T04:05:50.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12902024-08-28T04:05:50.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12912024-08-28T04:05:50.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12922024-08-28T04:05:50.226ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12932024-08-28T04:05:50.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12942024-08-28T04:05:50.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12952024-08-28T04:05:50.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12962024-08-28T04:05:50.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12972024-08-28T04:05:50.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12982024-08-28T04:05:50.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
12992024-08-28T04:05:50.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13002024-08-28T04:05:50.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13012024-08-28T04:05:50.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13022024-08-28T04:05:50.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13032024-08-28T04:05:50.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13042024-08-28T04:05:50.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13052024-08-28T04:05:50.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13062024-08-28T04:05:50.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13072024-08-28T04:05:50.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13082024-08-28T04:05:50.240ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13092024-08-28T04:05:50.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13102024-08-28T04:05:50.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13112024-08-28T04:05:50.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13122024-08-28T04:05:50.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13132024-08-28T04:05:50.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13142024-08-28T04:05:50.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13152024-08-28T04:05:50.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13162024-08-28T04:05:50.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13172024-08-28T04:05:50.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13182024-08-28T04:05:50.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13192024-08-28T04:05:50.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13202024-08-28T04:05:50.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13212024-08-28T04:05:50.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13222024-08-28T04:05:50.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13232024-08-28T04:05:50.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13242024-08-28T04:05:50.258ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13252024-08-28T04:05:50.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13262024-08-28T04:05:50.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13272024-08-28T04:05:50.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13282024-08-28T04:05:50.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13292024-08-28T04:05:50.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13302024-08-28T04:05:50.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13312024-08-28T04:05:50.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13322024-08-28T04:05:50.265ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13332024-08-28T04:05:50.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13342024-08-28T04:05:50.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13352024-08-28T04:05:50.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13362024-08-28T04:05:50.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13372024-08-28T04:05:50.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13382024-08-28T04:05:50.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13392024-08-28T04:05:50.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13402024-08-28T04:05:50.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13412024-08-28T04:05:50.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13422024-08-28T04:05:50.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13432024-08-28T04:05:50.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13442024-08-28T04:05:50.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13452024-08-28T04:05:50.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13462024-08-28T04:05:50.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13472024-08-28T04:05:50.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13482024-08-28T04:05:50.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13492024-08-28T04:05:50.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13502024-08-28T04:05:50.284ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13512024-08-28T04:05:50.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13522024-08-28T04:05:50.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13532024-08-28T04:05:50.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13542024-08-28T04:05:50.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13552024-08-28T04:05:50.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13562024-08-28T04:05:50.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13572024-08-28T04:05:50.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13582024-08-28T04:05:50.290ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13592024-08-28T04:05:50.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13602024-08-28T04:05:50.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13612024-08-28T04:05:50.301ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 4b747939-586b-48cb-a488-7f7f972db309, kind: Service { id: 4eb364e4-14a2-46c4-b173-eb2890920e8f }, name: Name("external-dns-4eb364e4-14a2-46c4-b173-eb2890920e8f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 113])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a3e0f17f-d79d-4cc0-ba0f-997e844ad5f3, kind: Service { id: 94b35d7a-af71-4078-a57c-874ff9a27068 }, name: Name("external-dns-94b35d7a-af71-4078-a57c-874ff9a27068"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 179])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 0cddb53a-efd3-4f89-93d7-81b182af0cdb, kind: Service { id: 1c6ee351-cab6-4c23-8658-c31bac40b40a }, name: Name("nexus-1c6ee351-cab6-4c23-8658-c31bac40b40a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 245])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1a83b6d1-627c-41ca-8268-a29f26800e91, kind: Service { id: 4c8a8ded-ced6-466f-8626-7fd39c37d020 }, name: Name("nexus-4c8a8ded-ced6-466f-8626-7fd39c37d020"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 34a49c6e-26fe-4abd-8702-695d279dbdca, kind: Service { id: bda2ed8e-2ea5-41eb-824b-d14527b76b8b }, name: Name("nexus-bda2ed8e-2ea5-41eb-824b-d14527b76b8b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
13622024-08-28T04:05:50.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13632024-08-28T04:05:50.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13642024-08-28T04:05:50.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13652024-08-28T04:05:50.304ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Fleet result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13662024-08-28T04:05:50.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 roles = RoleSet { roles: {} } uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13672024-08-28T04:05:50.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 resource = Database result = Ok(()) uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13682024-08-28T04:05:50.305ZDEBGnexus: Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
13692024-08-28T04:05:50.307ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4b747939-586b-48cb-a488-7f7f972db309, kind: Service { id: 4eb364e4-14a2-46c4-b173-eb2890920e8f }, name: Name("external-dns-4eb364e4-14a2-46c4-b173-eb2890920e8f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 113])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a3e0f17f-d79d-4cc0-ba0f-997e844ad5f3, kind: Service { id: 94b35d7a-af71-4078-a57c-874ff9a27068 }, name: Name("external-dns-94b35d7a-af71-4078-a57c-874ff9a27068"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 179])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0cddb53a-efd3-4f89-93d7-81b182af0cdb, kind: Service { id: 1c6ee351-cab6-4c23-8658-c31bac40b40a }, name: Name("nexus-1c6ee351-cab6-4c23-8658-c31bac40b40a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 245])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1a83b6d1-627c-41ca-8268-a29f26800e91, kind: Service { id: 4c8a8ded-ced6-466f-8626-7fd39c37d020 }, name: Name("nexus-4c8a8ded-ced6-466f-8626-7fd39c37d020"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 34a49c6e-26fe-4abd-8702-695d279dbdca, kind: Service { id: bda2ed8e-2ea5-41eb-824b-d14527b76b8b }, name: Name("nexus-bda2ed8e-2ea5-41eb-824b-d14527b76b8b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
13702024-08-28T04:05:50.307ZDEBGnexus: resolved 2 rules for sleds
13712024-08-28T04:05:50.324ZDEBGnexus: resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, time_created: 2024-08-28T04:05:44.270073Z, time_modified: 2024-08-28T04:05:44.270073Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
13722024-08-28T04:05:50.324ZDEBGnexus: sending firewall rules to sled agents
13732024-08-28T04:05:50.324ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
13742024-08-28T04:05:50.324ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
13752024-08-28T04:05:50.326ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
13762024-08-28T04:05:50.326ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
13772024-08-28T04:05:50.327ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
13782024-08-28T04:05:50.329ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
13792024-08-28T04:05:50.360ZDEBGnexus: client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
13802024-08-28T04:05:50.367ZDEBGnexus: client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fec00fc3-2df2-4a68-93bb-185faea482fe", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
13812024-08-28T04:05:50.368ZINFOnexus: updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
13822024-08-28T04:05:50.368ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Signaled
13832024-08-28T04:05:50.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1085328 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33295 req_id = 7df31546-de62-4520-932a-ca320bfa8b50 response_code = 204 uri = /racks/8b05f6f6-ff29-4d8c-aa09-514d34e6a880/initialization-complete
13842024-08-28T04:05:50.368ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Signaled
13852024-08-28T04:05:50.368ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13862024-08-28T04:05:50.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13872024-08-28T04:05:50.368ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Signaled
13882024-08-28T04:05:50.368ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Signaled
13892024-08-28T04:05:50.368ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Signaled
13902024-08-28T04:05:50.368ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13912024-08-28T04:05:50.368ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
13922024-08-28T04:05:50.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13932024-08-28T04:05:50.368ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13942024-08-28T04:05:50.368ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13952024-08-28T04:05:50.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13962024-08-28T04:05:50.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13972024-08-28T04:05:50.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13982024-08-28T04:05:50.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13992024-08-28T04:05:50.369ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14002024-08-28T04:05:50.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14012024-08-28T04:05:50.369ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14022024-08-28T04:05:50.369ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4eb364e4-14a2-46c4-b173-eb2890920e8f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1037, tv_nsec: 451167514 } })
14032024-08-28T04:05:50.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14042024-08-28T04:05:50.370ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("037b07ce-9e39-4982-8c20-c4c38f448b97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4e2ba65e-422a-4b1e-b0e3-85f8149a979a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1037, tv_nsec: 451301308 } })
14052024-08-28T04:05:50.371ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14062024-08-28T04:05:50.371ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14072024-08-28T04:05:50.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14082024-08-28T04:05:50.371ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
14092024-08-28T04:05:50.371ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.240875ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
14102024-08-28T04:05:50.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14112024-08-28T04:05:50.372ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
14122024-08-28T04:05:50.372ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.213064ms iteration = 2 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
14132024-08-28T04:05:50.374ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
14142024-08-28T04:05:50.374ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14152024-08-28T04:05:50.374ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14162024-08-28T04:05:50.374ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14172024-08-28T04:05:50.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14182024-08-28T04:05:50.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14192024-08-28T04:05:50.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14202024-08-28T04:05:50.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14212024-08-28T04:05:50.376ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
14222024-08-28T04:05:50.376ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
14232024-08-28T04:05:50.376ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
14242024-08-28T04:05:50.376ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14252024-08-28T04:05:50.377ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(f2e305be-9263-4cf5-9159-57a290d589de, 0), (5e6b5f76-3496-4fc4-bb61-63c102d825ed, 0), (a6de3f37-8ce3-40a7-80bf-299648918d43, 0), (5a7e69ca-596b-45b1-8c85-f12a2e81fc22, 0)] collection_id = f2e305be-9263-4cf5-9159-57a290d589de
14262024-08-28T04:05:50.377ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14272024-08-28T04:05:50.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14282024-08-28T04:05:50.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14292024-08-28T04:05:50.377ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14302024-08-28T04:05:50.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14312024-08-28T04:05:50.378ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14322024-08-28T04:05:50.379ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14332024-08-28T04:05:50.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14342024-08-28T04:05:50.381ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14352024-08-28T04:05:50.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14362024-08-28T04:05:50.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
14372024-08-28T04:05:50.382ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14382024-08-28T04:05:50.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14392024-08-28T04:05:50.383ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
14402024-08-28T04:05:50.383ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
14412024-08-28T04:05:50.383ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14422024-08-28T04:05:50.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14432024-08-28T04:05:50.385ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14442024-08-28T04:05:50.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14452024-08-28T04:05:50.388ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14462024-08-28T04:05:50.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14472024-08-28T04:05:50.399ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
14482024-08-28T04:05:50.399ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
14492024-08-28T04:05:50.399ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
14502024-08-28T04:05:50.399ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 30.877498ms iteration = 2 status = {"generation":1}
14512024-08-28T04:05:50.399ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Dependency
14522024-08-28T04:05:50.412ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = f2e305be-9263-4cf5-9159-57a290d589de file = nexus/db-queries/src/db/datastore/inventory.rs:1299 ncabooses = 12 ncollections = 1 nerrors = 0 nnics = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
14532024-08-28T04:05:50.412ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14542024-08-28T04:05:50.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14552024-08-28T04:05:50.418ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(5e6b5f76-3496-4fc4-bb61-63c102d825ed, 0), (a6de3f37-8ce3-40a7-80bf-299648918d43, 0), (5a7e69ca-596b-45b1-8c85-f12a2e81fc22, 0)]
14562024-08-28T04:05:50.418ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1037, tv_nsec: 499765952 } })
14572024-08-28T04:05:50.422ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
14582024-08-28T04:05:50.422ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
14592024-08-28T04:05:50.422ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
14602024-08-28T04:05:50.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14612024-08-28T04:05:50.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14622024-08-28T04:05:50.422ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14632024-08-28T04:05:50.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14642024-08-28T04:05:50.424ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14652024-08-28T04:05:50.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14662024-08-28T04:05:50.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14672024-08-28T04:05:50.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14682024-08-28T04:05:50.444ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
14692024-08-28T04:05:50.452ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14702024-08-28T04:05:50.454ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14712024-08-28T04:05:50.454ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14722024-08-28T04:05:50.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14732024-08-28T04:05:50.462ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
14742024-08-28T04:05:50.462ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 0 version = 2
14752024-08-28T04:05:50.462ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14762024-08-28T04:05:50.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14772024-08-28T04:05:50.464ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14782024-08-28T04:05:50.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14792024-08-28T04:05:50.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14802024-08-28T04:05:50.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14812024-08-28T04:05:50.469ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 1 version = 2
14822024-08-28T04:05:50.469ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
14832024-08-28T04:05:50.469ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
14842024-08-28T04:05:50.469ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 100.673927ms iteration = 2 status = {"generation":2}
14852024-08-28T04:05:50.469ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Dependency
14862024-08-28T04:05:50.485ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T04:05:35.065116Z, time_modified: 2024-08-28T04:05:35.065116Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
14872024-08-28T04:05:50.485ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 116.856043ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]}},"default_endpoint":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
14882024-08-28T04:05:50.494ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
14892024-08-28T04:05:50.494ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
14902024-08-28T04:05:50.494ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
14912024-08-28T04:05:50.495ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/ignition", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5aeaba2d-480c-4b7d-8569-9646000dc4c1", "content-length": "476", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
14922024-08-28T04:05:50.495ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
14932024-08-28T04:05:50.495ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "10cd0b04-03f3-41d2-a22b-2b89caa3b043", "content-length": "734", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
14942024-08-28T04:05:50.495ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
14952024-08-28T04:05:50.495ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "930e9c24-8bab-40f3-8fc0-f5048011afe5", "content-length": "86", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
14962024-08-28T04:05:50.495ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
14972024-08-28T04:05:50.495ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "58c6f60d-2374-4f13-ace6-25785e102d9d", "content-length": "86", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
14982024-08-28T04:05:50.496ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
14992024-08-28T04:05:50.496ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5cb6ed9c-f3ce-43aa-bcc0-9e84c7a04eae", "content-length": "80", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15002024-08-28T04:05:50.496ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
15012024-08-28T04:05:50.497ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "57023816-ff39-407c-a843-48a4cf30de87", "content-length": "80", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15022024-08-28T04:05:50.497ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
15032024-08-28T04:05:50.497ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "71f981e5-09d7-4ff0-8a9f-228adf2383b7", "content-length": "88", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15042024-08-28T04:05:50.497ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
15052024-08-28T04:05:50.497ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9f469128-f1cb-4715-bf89-ddd67b58f3b9", "content-length": "88", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15062024-08-28T04:05:50.497ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
15072024-08-28T04:05:50.497ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "efb87f16-748f-45ec-a2cd-1cc18e34a099", "content-length": "702", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15082024-08-28T04:05:50.497ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
15092024-08-28T04:05:50.497ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "af9609d8-67dc-4043-b02f-970b336b02e5", "content-length": "727", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15102024-08-28T04:05:50.497ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
15112024-08-28T04:05:50.497ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "170bc083-50a1-418c-a43d-e57471047a6b", "content-length": "729", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15122024-08-28T04:05:50.497ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
15132024-08-28T04:05:50.498ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7359c26b-e53b-40e3-8c44-75696fcff4ae", "content-length": "728", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15142024-08-28T04:05:50.498ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
15152024-08-28T04:05:50.498ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "10b0a6a7-59d8-40f1-921b-29c8a38dfc0c", "content-length": "722", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15162024-08-28T04:05:50.498ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
15172024-08-28T04:05:50.499ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "03e590a2-5f6e-43db-b73a-b66ca8987af9", "content-length": "84", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15182024-08-28T04:05:50.499ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
15192024-08-28T04:05:50.499ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "05b86a2c-482c-450b-9cb4-59b9d666a91e", "content-length": "84", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15202024-08-28T04:05:50.499ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
15212024-08-28T04:05:50.499ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f0c84d55-3569-4672-859a-91c202f014c2", "content-length": "82", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15222024-08-28T04:05:50.499ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
15232024-08-28T04:05:50.499ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4538571b-7fc0-4dc0-a5a8-f4f414cc9f0b", "content-length": "82", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15242024-08-28T04:05:50.499ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
15252024-08-28T04:05:50.500ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4ba23d61-e24d-4e0f-b8c3-f7d92918f38d", "content-length": "91", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15262024-08-28T04:05:50.500ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
15272024-08-28T04:05:50.501ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "90fea536-8e64-44e0-93c0-5452e6f49e00", "content-length": "91", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15282024-08-28T04:05:50.501ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
15292024-08-28T04:05:50.501ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "92dd6963-00ea-45ea-9646-5a118fdf5669", "content-length": "702", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15302024-08-28T04:05:50.501ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
15312024-08-28T04:05:50.501ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ba4f12ef-056d-49d8-80e1-c919fecea01b", "content-length": "727", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15322024-08-28T04:05:50.501ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
15332024-08-28T04:05:50.501ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d957c497-3aeb-4ff7-8d73-7fb16e578e25", "content-length": "729", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15342024-08-28T04:05:50.501ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
15352024-08-28T04:05:50.501ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e3787db4-768f-4fa4-8096-3959e360ff04", "content-length": "728", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
15362024-08-28T04:05:50.501ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15372024-08-28T04:05:50.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15382024-08-28T04:05:50.503ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15392024-08-28T04:05:50.504ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
15402024-08-28T04:05:50.504ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15412024-08-28T04:05:50.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15422024-08-28T04:05:50.506ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15432024-08-28T04:05:50.508ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
15442024-08-28T04:05:50.508ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15452024-08-28T04:05:50.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15462024-08-28T04:05:50.519ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
15472024-08-28T04:05:50.534ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15482024-08-28T04:05:50.534ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15492024-08-28T04:05:50.535ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15502024-08-28T04:05:50.536ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15512024-08-28T04:05:50.539ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15522024-08-28T04:05:50.542ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, lookup_type: ById(8b05f6f6-ff29-4d8c-aa09-514d34e6a880) } result = Ok(())
15532024-08-28T04:05:50.542ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:762
15542024-08-28T04:05:50.542ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15552024-08-28T04:05:50.542ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15562024-08-28T04:05:50.543ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15572024-08-28T04:05:50.544ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15582024-08-28T04:05:50.544ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15592024-08-28T04:05:50.546ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15602024-08-28T04:05:50.546ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15612024-08-28T04:05:50.547ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15622024-08-28T04:05:50.547ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15632024-08-28T04:05:50.548ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15642024-08-28T04:05:50.549ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15652024-08-28T04:05:50.550ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15662024-08-28T04:05:50.550ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15672024-08-28T04:05:50.551ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15682024-08-28T04:05:50.555ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
15692024-08-28T04:05:50.555ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15702024-08-28T04:05:50.555ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15712024-08-28T04:05:50.556ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15722024-08-28T04:05:50.556ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15732024-08-28T04:05:50.589ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
15742024-08-28T04:05:50.610ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6ae7788c-0bfd-4cc2-8caf-df415607acb4", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15752024-08-28T04:05:50.610ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15762024-08-28T04:05:50.613ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d5a1a3bc-827e-4531-b1d7-44971c15c909", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15772024-08-28T04:05:50.613ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15782024-08-28T04:05:50.618ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
15792024-08-28T04:05:50.621ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
15802024-08-28T04:05:50.621ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
15812024-08-28T04:05:50.627ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8d3ff523-0ffd-4973-8fa9-46a0aba39c3f", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15822024-08-28T04:05:50.627ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15832024-08-28T04:05:50.628ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15842024-08-28T04:05:50.628ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 229.366937ms iteration = 3 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
15852024-08-28T04:05:50.640ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "109ae137-bcaa-4e3b-b964-e4291d7462fe", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15862024-08-28T04:05:50.640ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15872024-08-28T04:05:50.642ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "487621db-411a-4a59-8d5c-c6cd31406778", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15882024-08-28T04:05:50.642ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15892024-08-28T04:05:50.644ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15902024-08-28T04:05:50.644ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 175.181955ms iteration = 3 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
15912024-08-28T04:05:50.647ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15922024-08-28T04:05:50.647ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15932024-08-28T04:05:50.649ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15942024-08-28T04:05:50.652ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
15952024-08-28T04:05:50.652ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15962024-08-28T04:05:50.652ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15972024-08-28T04:05:50.668ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15982024-08-28T04:05:50.668ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15992024-08-28T04:05:50.670ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16002024-08-28T04:05:50.670ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16012024-08-28T04:05:50.672ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16022024-08-28T04:05:50.672ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16032024-08-28T04:05:50.673ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16042024-08-28T04:05:50.673ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16052024-08-28T04:05:50.675ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16062024-08-28T04:05:50.675ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16072024-08-28T04:05:50.679ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16082024-08-28T04:05:50.679ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16092024-08-28T04:05:50.681ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16102024-08-28T04:05:50.684ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
16112024-08-28T04:05:50.684ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16122024-08-28T04:05:50.684ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16132024-08-28T04:05:50.686ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16142024-08-28T04:05:50.686ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16152024-08-28T04:05:50.687ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16162024-08-28T04:05:50.687ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16172024-08-28T04:05:50.689ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16182024-08-28T04:05:50.690ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16192024-08-28T04:05:50.691ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16202024-08-28T04:05:50.691ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16212024-08-28T04:05:50.693ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16222024-08-28T04:05:50.693ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16232024-08-28T04:05:50.694ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16242024-08-28T04:05:50.694ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16252024-08-28T04:05:50.695ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16262024-08-28T04:05:50.698ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
16272024-08-28T04:05:50.698ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16282024-08-28T04:05:50.699ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16292024-08-28T04:05:50.700ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16302024-08-28T04:05:50.700ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16312024-08-28T04:05:50.701ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16322024-08-28T04:05:50.702ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16332024-08-28T04:05:50.703ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16342024-08-28T04:05:50.706ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
16352024-08-28T04:05:50.706ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16362024-08-28T04:05:50.706ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16372024-08-28T04:05:50.710ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16382024-08-28T04:05:50.710ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16392024-08-28T04:05:50.711ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16402024-08-28T04:05:50.711ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16412024-08-28T04:05:50.713ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16422024-08-28T04:05:50.713ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16432024-08-28T04:05:50.715ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16442024-08-28T04:05:50.715ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16452024-08-28T04:05:50.717ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16462024-08-28T04:05:50.717ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16472024-08-28T04:05:50.718ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16482024-08-28T04:05:50.718ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16492024-08-28T04:05:50.719ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16502024-08-28T04:05:50.719ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/inventory", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b3ffe745-621c-42e6-a79c-ebda2cdd3c7c", "content-length": "2360", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
16512024-08-28T04:05:50.719ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/omicron-zones
16522024-08-28T04:05:50.719ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16532024-08-28T04:05:50.721ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16542024-08-28T04:05:50.721ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/omicron-zones", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3f80c3ec-2232-46a1-95df-25ecc47ad2b1", "content-length": "10314", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
16552024-08-28T04:05:50.723ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
16562024-08-28T04:05:50.723ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
16572024-08-28T04:05:50.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
16582024-08-28T04:05:50.724ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
16592024-08-28T04:05:50.724ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16602024-08-28T04:05:50.724ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16612024-08-28T04:05:50.724ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16622024-08-28T04:05:50.726ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16632024-08-28T04:05:50.726ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16642024-08-28T04:05:50.726ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
16652024-08-28T04:05:50.727ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16662024-08-28T04:05:50.727ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16672024-08-28T04:05:50.728ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16682024-08-28T04:05:50.728ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
16692024-08-28T04:05:50.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
16702024-08-28T04:05:50.731ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
16712024-08-28T04:05:50.731ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16722024-08-28T04:05:50.731ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16732024-08-28T04:05:50.738ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 0cddb53a-efd3-4f89-93d7-81b182af0cdb, kind: Service { id: 1c6ee351-cab6-4c23-8658-c31bac40b40a }, name: Name("nexus-1c6ee351-cab6-4c23-8658-c31bac40b40a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 245])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1a83b6d1-627c-41ca-8268-a29f26800e91, kind: Service { id: 4c8a8ded-ced6-466f-8626-7fd39c37d020 }, name: Name("nexus-4c8a8ded-ced6-466f-8626-7fd39c37d020"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 34a49c6e-26fe-4abd-8702-695d279dbdca, kind: Service { id: bda2ed8e-2ea5-41eb-824b-d14527b76b8b }, name: Name("nexus-bda2ed8e-2ea5-41eb-824b-d14527b76b8b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 4b747939-586b-48cb-a488-7f7f972db309, kind: Service { id: 4eb364e4-14a2-46c4-b173-eb2890920e8f }, name: Name("external-dns-4eb364e4-14a2-46c4-b173-eb2890920e8f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 113])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a3e0f17f-d79d-4cc0-ba0f-997e844ad5f3, kind: Service { id: 94b35d7a-af71-4078-a57c-874ff9a27068 }, name: Name("external-dns-94b35d7a-af71-4078-a57c-874ff9a27068"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 179])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
16742024-08-28T04:05:50.738ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16752024-08-28T04:05:50.738ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16762024-08-28T04:05:50.739ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16772024-08-28T04:05:50.741ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
16782024-08-28T04:05:50.741ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16792024-08-28T04:05:50.741ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16802024-08-28T04:05:50.743ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
16812024-08-28T04:05:50.743ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4b747939-586b-48cb-a488-7f7f972db309, kind: Service { id: 4eb364e4-14a2-46c4-b173-eb2890920e8f }, name: Name("external-dns-4eb364e4-14a2-46c4-b173-eb2890920e8f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 113])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a3e0f17f-d79d-4cc0-ba0f-997e844ad5f3, kind: Service { id: 94b35d7a-af71-4078-a57c-874ff9a27068 }, name: Name("external-dns-94b35d7a-af71-4078-a57c-874ff9a27068"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 179])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0cddb53a-efd3-4f89-93d7-81b182af0cdb, kind: Service { id: 1c6ee351-cab6-4c23-8658-c31bac40b40a }, name: Name("nexus-1c6ee351-cab6-4c23-8658-c31bac40b40a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 245])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1a83b6d1-627c-41ca-8268-a29f26800e91, kind: Service { id: 4c8a8ded-ced6-466f-8626-7fd39c37d020 }, name: Name("nexus-4c8a8ded-ced6-466f-8626-7fd39c37d020"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 34a49c6e-26fe-4abd-8702-695d279dbdca, kind: Service { id: bda2ed8e-2ea5-41eb-824b-d14527b76b8b }, name: Name("nexus-bda2ed8e-2ea5-41eb-824b-d14527b76b8b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
16822024-08-28T04:05:50.743ZDEBGnexus (InternalApi): resolved 2 rules for sleds
16832024-08-28T04:05:50.890ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, time_created: 2024-08-28T04:05:44.270073Z, time_modified: 2024-08-28T04:05:44.270073Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
16842024-08-28T04:05:50.890ZDEBGnexus (InternalApi): sending firewall rules to sled agents
16852024-08-28T04:05:50.890ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16862024-08-28T04:05:50.891ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16872024-08-28T04:05:50.893ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16882024-08-28T04:05:50.894ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16892024-08-28T04:05:50.895ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16902024-08-28T04:05:50.895ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 802ab3ab-37ef-401f-9431-45d7c40a191f file = nexus/db-queries/src/db/datastore/inventory.rs:893
16912024-08-28T04:05:50.897ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 802ab3ab-37ef-401f-9431-45d7c40a191f time_started = 2024-08-28 04:05:50.493798 UTC
16922024-08-28T04:05:50.897ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 529.123852ms iteration = 2 status = {"collection_id":"802ab3ab-37ef-401f-9431-45d7c40a191f","time_done":"2024-08-28 04:05:50.723484 UTC","time_started":"2024-08-28 04:05:50.493798 UTC"}
16932024-08-28T04:05:50.897ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
16942024-08-28T04:05:50.897ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16952024-08-28T04:05:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16962024-08-28T04:05:50.898ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
16972024-08-28T04:05:50.899ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16982024-08-28T04:05:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16992024-08-28T04:05:50.901ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17002024-08-28T04:05:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17012024-08-28T04:05:50.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17022024-08-28T04:05:50.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17032024-08-28T04:05:50.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17042024-08-28T04:05:50.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17052024-08-28T04:05:50.906ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17062024-08-28T04:05:50.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17072024-08-28T04:05:50.930ZDEBGnexus (InternalApi): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17082024-08-28T04:05:50.931ZDEBGnexus (InternalApi): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fe5afd96-b671-4201-833a-5cfd9b9d047c", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
17092024-08-28T04:05:50.931ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
17102024-08-28T04:05:50.931ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
17112024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /
17122024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /access
17132024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /assets/{path}
17142024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/auth
17152024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/confirm
17162024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/success
17172024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/token
17182024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/verify
17192024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes
17202024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /experimental/v1/probes
17212024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /experimental/v1/probes/{probe}
17222024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes/{probe}
17232024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /images
17242024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login
17252024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/local
17262024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}
17272024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /login/{silo_name}/saml/{provider_name}
17282024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
17292024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /lookup/{path}
17302024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects/{path}
17312024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects-new
17322024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /settings/{path}
17332024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /system/{path}
17342024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /utilization
17352024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates
17362024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/certificates
17372024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/certificates/{certificate}
17382024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates/{certificate}
17392024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks
17402024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks
17412024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/disks/{disk}
17422024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}
17432024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write
17442024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-start
17452024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-stop
17462024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/finalize
17472024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}/metrics/{metric}
17482024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips
17492024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips
17502024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/floating-ips/{floating_ip}
17512024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips/{floating_ip}
17522024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/floating-ips/{floating_ip}
17532024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/attach
17542024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/detach
17552024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups
17562024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups/{group_id}
17572024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images
17582024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images
17592024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/images/{image}
17602024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images/{image}
17612024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/demote
17622024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/promote
17632024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances
17642024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances
17652024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}
17662024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}
17672024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/disks
17682024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/attach
17692024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/detach
17702024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/external-ips
17712024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
17722024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
17732024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/reboot
17742024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console
17752024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console/stream
17762024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/ssh-public-keys
17772024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/start
17782024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/stop
17792024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools
17802024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools/{pool}
17812024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/login/{silo_name}/local
17822024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/logout
17832024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me
17842024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/groups
17852024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys
17862024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/me/ssh-keys
17872024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
17882024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys/{ssh_key}
17892024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/metrics/{metric_name}
17902024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces
17912024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/network-interfaces
17922024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/network-interfaces/{interface}
17932024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces/{interface}
17942024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/network-interfaces/{interface}
17952024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ping
17962024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/policy
17972024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/policy
17982024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects
17992024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/projects
18002024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/projects/{project}
18012024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}
18022024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}
18032024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}/policy
18042024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}/policy
18052024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots
18062024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/snapshots
18072024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/snapshots/{snapshot}
18082024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots/{snapshot}
18092024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks
18102024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks/{disk_id}
18112024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks
18122024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks/{rack_id}
18132024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds
18142024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/sleds
18152024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}
18162024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
18172024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
18182024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
18192024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds-uninitialized
18202024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port
18212024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
18222024-08-28T04:05:50.945ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings
18232024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port/{port}/status
18242024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches
18252024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches/{switch_id}
18262024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers
18272024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users
18282024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
18292024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
18302024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/saml
18312024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers/saml/{provider}
18322024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools
18332024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools
18342024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}
18352024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}
18362024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}
18372024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/ranges
18382024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
18392024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
18402024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/silos
18412024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/silos
18422024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
18432024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
18442024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/utilization
18452024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service
18462024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service/ranges
18472024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/add
18482024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/remove
18492024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/metrics/{metric_name}
18502024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot
18512024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/address-lot
18522024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
18532024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
18542024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/allow-list
18552024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/allow-list
18562024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-disable
18572024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-enable
18582024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bfd-status
18592024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp
18602024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp
18612024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bgp
18622024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set
18632024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/bgp-announce-set
18642024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{name_or_id}
18652024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set/{name_or_id}/announcement
18662024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-exported
18672024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-message-history
18682024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-routes-ipv4
18692024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-status
18702024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/loopback-address
18712024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/loopback-address
18722024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
18732024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/switch-port-settings
18742024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings
18752024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/switch-port-settings
18762024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings/{port}
18772024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/policy
18782024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/policy
18792024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles
18802024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles/{role_name}
18812024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silo-quotas
18822024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos
18832024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/silos
18842024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/silos/{silo}
18852024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}
18862024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/ip-pools
18872024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/policy
18882024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/policy
18892024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/quotas
18902024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/quotas
18912024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/update/repository
18922024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/update/repository/{system_version}
18932024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users
18942024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users/{user_id}
18952024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin
18962024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin/{user}
18972024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos
18982024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos/{silo}
18992024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/timeseries/query
19002024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/timeseries/schema
19012024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/users
19022024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/utilization
19032024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-firewall-rules
19042024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-firewall-rules
19052024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes
19062024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-router-routes
19072024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-router-routes/{route}
19082024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes/{route}
19092024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-router-routes/{route}
19102024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers
19112024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-routers
19122024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-routers/{router}
19132024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers/{router}
19142024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-routers/{router}
19152024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets
19162024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-subnets
19172024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-subnets/{subnet}
19182024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}
19192024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-subnets/{subnet}
19202024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
19212024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs
19222024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpcs
19232024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpcs/{vpc}
19242024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs/{vpc}
19252024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpcs/{vpc}
19262024-08-28T04:05:50.946ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = 172.30.2.6:443
19272024-08-28T04:05:50.946ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.6:443
19282024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /
19292024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /access
19302024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /assets/{path}
19312024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/auth
19322024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/confirm
19332024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/success
19342024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/token
19352024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/verify
19362024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes
19372024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /experimental/v1/probes
19382024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /experimental/v1/probes/{probe}
19392024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes/{probe}
19402024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /images
19412024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login
19422024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/local
19432024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}
19442024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /login/{silo_name}/saml/{provider_name}
19452024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
19462024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /lookup/{path}
19472024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects/{path}
19482024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects-new
19492024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /settings/{path}
19502024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /system/{path}
19512024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /utilization
19522024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates
19532024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/certificates
19542024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/certificates/{certificate}
19552024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates/{certificate}
19562024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks
19572024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks
19582024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/disks/{disk}
19592024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}
19602024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write
19612024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start
19622024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop
19632024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/finalize
19642024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric}
19652024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips
19662024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips
19672024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/floating-ips/{floating_ip}
19682024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips/{floating_ip}
19692024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/floating-ips/{floating_ip}
19702024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach
19712024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach
19722024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups
19732024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups/{group_id}
19742024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images
19752024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images
19762024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/images/{image}
19772024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images/{image}
19782024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/demote
19792024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/promote
19802024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances
19812024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances
19822024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}
19832024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}
19842024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/disks
19852024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/attach
19862024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/detach
19872024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/external-ips
19882024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
19892024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
19902024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/reboot
19912024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console
19922024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream
19932024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys
19942024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/start
19952024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/stop
19962024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools
19972024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools/{pool}
19982024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/login/{silo_name}/local
19992024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/logout
20002024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me
20012024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/groups
20022024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys
20032024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/me/ssh-keys
20042024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
20052024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key}
20062024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/metrics/{metric_name}
20072024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces
20082024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/network-interfaces
20092024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/network-interfaces/{interface}
20102024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces/{interface}
20112024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/network-interfaces/{interface}
20122024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ping
20132024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/policy
20142024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/policy
20152024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects
20162024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/projects
20172024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/projects/{project}
20182024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}
20192024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}
20202024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}/policy
20212024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}/policy
20222024-08-28T04:05:50.950ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots
20232024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/snapshots
20242024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/snapshots/{snapshot}
20252024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots/{snapshot}
20262024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks
20272024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks/{disk_id}
20282024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks
20292024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks/{rack_id}
20302024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds
20312024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/sleds
20322024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}
20332024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
20342024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
20352024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
20362024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized
20372024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port
20382024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
20392024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings
20402024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status
20412024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches
20422024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches/{switch_id}
20432024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers
20442024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users
20452024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
20462024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
20472024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/saml
20482024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers/saml/{provider}
20492024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools
20502024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools
20512024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}
20522024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}
20532024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}
20542024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges
20552024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
20562024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
20572024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos
20582024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos
20592024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
20602024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
20612024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization
20622024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service
20632024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service/ranges
20642024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add
20652024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove
20662024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/metrics/{metric_name}
20672024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot
20682024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/address-lot
20692024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
20702024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
20712024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/allow-list
20722024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/allow-list
20732024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-disable
20742024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-enable
20752024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bfd-status
20762024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp
20772024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp
20782024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bgp
20792024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set
20802024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/bgp-announce-set
20812024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{name_or_id}
20822024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{name_or_id}/announcement
20832024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-exported
20842024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-message-history
20852024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4
20862024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-status
20872024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/loopback-address
20882024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/loopback-address
20892024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
20902024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/switch-port-settings
20912024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings
20922024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/switch-port-settings
20932024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port}
20942024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/policy
20952024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/policy
20962024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles
20972024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles/{role_name}
20982024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silo-quotas
20992024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos
21002024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/silos
21012024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/silos/{silo}
21022024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}
21032024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools
21042024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/policy
21052024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/policy
21062024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/quotas
21072024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/quotas
21082024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/update/repository
21092024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/update/repository/{system_version}
21102024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users
21112024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users/{user_id}
21122024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin
21132024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin/{user}
21142024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos
21152024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos/{silo}
21162024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/timeseries/query
21172024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/timeseries/schema
21182024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/users
21192024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/utilization
21202024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-firewall-rules
21212024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-firewall-rules
21222024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes
21232024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-router-routes
21242024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-router-routes/{route}
21252024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes/{route}
21262024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-router-routes/{route}
21272024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers
21282024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-routers
21292024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-routers/{router}
21302024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers/{router}
21312024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-routers/{router}
21322024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets
21332024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-subnets
21342024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-subnets/{subnet}
21352024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}
21362024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-subnets/{subnet}
21372024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
21382024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs
21392024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpcs
21402024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpcs/{vpc}
21412024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs/{vpc}
21422024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpcs/{vpc}
21432024-08-28T04:05:50.951ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::b]:12228
21442024-08-28T04:05:50.951ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12228
21452024-08-28T04:05:50.951ZDEBGnexus (nexus-producer-server): registered DTrace probes
21462024-08-28T04:05:50.952ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 55.014996ms iteration = 3 status = {"physical_disks_added":0}
21472024-08-28T04:05:50.955ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::b]:53641 method = GET path = /{producer_id}
21482024-08-28T04:05:50.956ZINFOnexus (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::b]:53641
21492024-08-28T04:05:50.956ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:53641
21502024-08-28T04:05:50.956ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::b]:53641
21512024-08-28T04:05:50.956ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::b]:12221
21522024-08-28T04:05:50.956ZDEBGnexus (nexus-producer-server): starting producer registration task
21532024-08-28T04:05:50.956ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::b]:53641 file = oximeter/producer/src/lib.rs:283 interval = 10s producer_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
21542024-08-28T04:05:50.956ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
21552024-08-28T04:05:50.956ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
21562024-08-28T04:05:50.988ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
21572024-08-28T04:05:50.988ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:33258
21582024-08-28T04:05:50.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33258 req_id = 2c30f1f8-9255-4798-a216-cc59b7d04a4c roles = RoleSet { roles: {} } uri = /metrics/producers
21592024-08-28T04:05:50.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33258 req_id = 2c30f1f8-9255-4798-a216-cc59b7d04a4c resource = Database result = Ok(()) uri = /metrics/producers
21602024-08-28T04:05:51.031ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
21612024-08-28T04:05:51.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33258 req_id = 2c30f1f8-9255-4798-a216-cc59b7d04a4c roles = RoleSet { roles: {} } uri = /metrics/producers
21622024-08-28T04:05:51.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33258 req_id = 2c30f1f8-9255-4798-a216-cc59b7d04a4c resource = Database result = Ok(()) uri = /metrics/producers
21632024-08-28T04:05:51.066ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
21642024-08-28T04:05:51.076ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "87a8dc2c-7290-484f-899e-8f4011397dfd", "date": "Wed, 28 Aug 2024 04:05:51 GMT"} })
21652024-08-28T04:05:51.076ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
21662024-08-28T04:05:51.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 88316 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33258 req_id = 2c30f1f8-9255-4798-a216-cc59b7d04a4c response_code = 201 uri = /metrics/producers
21672024-08-28T04:05:51.076ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "2c30f1f8-9255-4798-a216-cc59b7d04a4c", "content-length": "41", "date": "Wed, 28 Aug 2024 04:05:50 GMT"} })
21682024-08-28T04:05:51.078ZDEBGnexus (producer-registration-task): registered with nexus successfully
21692024-08-28T04:05:51.078ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
21702024-08-28T04:05:52.066ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" } server_name = recovery.sys.oxide.test silo_id = e3abc6f9-763c-486e-9205-7ca93e3777ea
21712024-08-28T04:05:52.075ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = 172.30.2.6:443 remote_addr = 10.151.2.100:64129
21722024-08-28T04:05:52.085ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21732024-08-28T04:05:52.086ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21742024-08-28T04:05:52.088ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21752024-08-28T04:05:52.088ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21762024-08-28T04:05:52.090ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21772024-08-28T04:05:52.090ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21782024-08-28T04:05:52.092ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21792024-08-28T04:05:52.093ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ByName("recovery") } result = Ok(())
21802024-08-28T04:05:52.093ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21812024-08-28T04:05:52.094ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21822024-08-28T04:05:52.095ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21832024-08-28T04:05:52.095ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21842024-08-28T04:05:52.097ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21852024-08-28T04:05:52.100ZDEBGnexus (ExternalAuthn): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ByName("recovery") } result = Ok(())
21862024-08-28T04:05:52.100ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21872024-08-28T04:05:52.100ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21882024-08-28T04:05:52.101ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21892024-08-28T04:05:52.102ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21902024-08-28T04:05:52.103ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21912024-08-28T04:05:52.103ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21922024-08-28T04:05:52.105ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21932024-08-28T04:05:52.106ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ByName("recovery") }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ByName("recovery") } result = Ok(())
21942024-08-28T04:05:52.106ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21952024-08-28T04:05:52.106ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21962024-08-28T04:05:52.811ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21972024-08-28T04:05:52.812ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21982024-08-28T04:05:52.820ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21992024-08-28T04:05:52.820ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22002024-08-28T04:05:52.822ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22012024-08-28T04:05:52.822ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22022024-08-28T04:05:52.824ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22032024-08-28T04:05:52.824ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22042024-08-28T04:05:52.826ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22052024-08-28T04:05:52.827ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
22062024-08-28T04:05:52.827ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22072024-08-28T04:05:52.827ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22082024-08-28T04:05:52.829ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22092024-08-28T04:05:52.830ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSessionList result = Ok(())
22102024-08-28T04:05:52.831ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22112024-08-28T04:05:52.831ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22122024-08-28T04:05:52.843ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 757274 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:64129 req_id = f33759bd-30c3-4544-9a75-e5aec3f06aca response_code = 204 uri = /v1/login/recovery/local
22132024-08-28T04:05:52.886ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" } server_name = recovery.sys.oxide.test silo_id = e3abc6f9-763c-486e-9205-7ca93e3777ea
22142024-08-28T04:05:52.895ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = 172.30.2.6:443 remote_addr = 10.151.2.100:32887
22152024-08-28T04:05:52.896ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22162024-08-28T04:05:52.896ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22172024-08-28T04:05:52.898ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22182024-08-28T04:05:52.898ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22192024-08-28T04:05:52.900ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22202024-08-28T04:05:52.901ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("token = \\"20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02\\"") } result = Ok(())
22212024-08-28T04:05:52.901ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22222024-08-28T04:05:52.901ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22232024-08-28T04:05:52.903ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22242024-08-28T04:05:52.903ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22252024-08-28T04:05:52.905ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22262024-08-28T04:05:52.905ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22272024-08-28T04:05:52.906ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22282024-08-28T04:05:52.906ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22292024-08-28T04:05:52.907ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22302024-08-28T04:05:52.908ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
22312024-08-28T04:05:52.908ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22322024-08-28T04:05:52.909ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22332024-08-28T04:05:52.910ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22342024-08-28T04:05:52.911ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02") } result = Ok(())
22352024-08-28T04:05:52.911ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22362024-08-28T04:05:52.911ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22372024-08-28T04:05:52.921ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22382024-08-28T04:05:52.922ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22392024-08-28T04:05:52.930ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22402024-08-28T04:05:52.931ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22412024-08-28T04:05:52.932ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22422024-08-28T04:05:52.932ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22432024-08-28T04:05:52.933ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22442024-08-28T04:05:52.933ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22452024-08-28T04:05:52.934ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22462024-08-28T04:05:52.936ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
22472024-08-28T04:05:52.936ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22482024-08-28T04:05:52.936ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22492024-08-28T04:05:52.937ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22502024-08-28T04:05:52.937ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22512024-08-28T04:05:52.938ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22522024-08-28T04:05:52.939ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22532024-08-28T04:05:52.940ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22542024-08-28T04:05:52.941ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) } result = Ok(())
22552024-08-28T04:05:52.942ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:32887 req_id = aa0ab511-d2f9-4d03-99ff-f9f44271cc0f roles = RoleSet { roles: {} } uri = /v1/projects
22562024-08-28T04:05:52.942ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:32887 req_id = aa0ab511-d2f9-4d03-99ff-f9f44271cc0f resource = Database result = Ok(()) uri = /v1/projects
22572024-08-28T04:05:52.945ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:32887 req_id = aa0ab511-d2f9-4d03-99ff-f9f44271cc0f roles = RoleSet { roles: {} } uri = /v1/projects
22582024-08-28T04:05:52.945ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:32887 req_id = aa0ab511-d2f9-4d03-99ff-f9f44271cc0f resource = Database result = Ok(()) uri = /v1/projects
22592024-08-28T04:05:52.954ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:32887 req_id = aa0ab511-d2f9-4d03-99ff-f9f44271cc0f roles = RoleSet { roles: {} } uri = /v1/projects
22602024-08-28T04:05:52.955ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:32887 req_id = aa0ab511-d2f9-4d03-99ff-f9f44271cc0f resource = Database result = Ok(()) uri = /v1/projects
22612024-08-28T04:05:52.963ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:32887 req_id = aa0ab511-d2f9-4d03-99ff-f9f44271cc0f roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/projects
22622024-08-28T04:05:52.965ZDEBGnexus (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:32887 req_id = aa0ab511-d2f9-4d03-99ff-f9f44271cc0f resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) } result = Ok(()) uri = /v1/projects
22632024-08-28T04:05:52.966ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:32887 req_id = aa0ab511-d2f9-4d03-99ff-f9f44271cc0f roles = RoleSet { roles: {} } uri = /v1/projects
22642024-08-28T04:05:52.966ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:32887 req_id = aa0ab511-d2f9-4d03-99ff-f9f44271cc0f resource = Database result = Ok(()) uri = /v1/projects
22652024-08-28T04:05:52.968ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 73619 local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:32887 req_id = aa0ab511-d2f9-4d03-99ff-f9f44271cc0f response_code = 200 uri = /v1/projects
22662024-08-28T04:05:52.973ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22672024-08-28T04:05:52.973ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22682024-08-28T04:05:52.975ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22692024-08-28T04:05:52.975ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22702024-08-28T04:05:52.976ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22712024-08-28T04:05:52.977ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("token = \\"20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02\\"") } result = Ok(())
22722024-08-28T04:05:52.977ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22732024-08-28T04:05:52.977ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22742024-08-28T04:05:52.979ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22752024-08-28T04:05:52.979ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22762024-08-28T04:05:52.980ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22772024-08-28T04:05:52.980ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22782024-08-28T04:05:52.981ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22792024-08-28T04:05:52.982ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22802024-08-28T04:05:52.983ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22812024-08-28T04:05:52.984ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
22822024-08-28T04:05:52.984ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22832024-08-28T04:05:52.984ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22842024-08-28T04:05:52.985ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22852024-08-28T04:05:52.986ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02") } result = Ok(())
22862024-08-28T04:05:52.986ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22872024-08-28T04:05:52.986ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22882024-08-28T04:05:52.997ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22892024-08-28T04:05:52.998ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22902024-08-28T04:05:52.999ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22912024-08-28T04:05:52.999ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22922024-08-28T04:05:53.000ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22932024-08-28T04:05:53.000ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22942024-08-28T04:05:53.002ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22952024-08-28T04:05:53.002ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22962024-08-28T04:05:53.003ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22972024-08-28T04:05:53.004ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
22982024-08-28T04:05:53.004ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22992024-08-28T04:05:53.004ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23002024-08-28T04:05:53.006ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23012024-08-28T04:05:53.006ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23022024-08-28T04:05:53.007ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23032024-08-28T04:05:53.008ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23042024-08-28T04:05:53.009ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23052024-08-28T04:05:53.010ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) } result = Ok(())
23062024-08-28T04:05:53.010ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = df24687a-c936-4f4f-9161-686aa2ee5dff roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
23072024-08-28T04:05:53.010ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = df24687a-c936-4f4f-9161-686aa2ee5dff resource = Database result = Ok(()) uri = /v1/system/ip-pools
23082024-08-28T04:05:53.020ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = df24687a-c936-4f4f-9161-686aa2ee5dff roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
23092024-08-28T04:05:53.020ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = df24687a-c936-4f4f-9161-686aa2ee5dff resource = Database result = Ok(()) uri = /v1/system/ip-pools
23102024-08-28T04:05:53.022ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = df24687a-c936-4f4f-9161-686aa2ee5dff roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/system/ip-pools
23112024-08-28T04:05:53.024ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = df24687a-c936-4f4f-9161-686aa2ee5dff resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools
23122024-08-28T04:05:53.024ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = df24687a-c936-4f4f-9161-686aa2ee5dff roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
23132024-08-28T04:05:53.024ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = df24687a-c936-4f4f-9161-686aa2ee5dff resource = Database result = Ok(()) uri = /v1/system/ip-pools
23142024-08-28T04:05:53.028ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 56365 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = df24687a-c936-4f4f-9161-686aa2ee5dff response_code = 201 uri = /v1/system/ip-pools
23152024-08-28T04:05:53.035ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23162024-08-28T04:05:53.036ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23172024-08-28T04:05:53.037ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23182024-08-28T04:05:53.037ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23192024-08-28T04:05:53.039ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23202024-08-28T04:05:53.040ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("token = \\"20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02\\"") } result = Ok(())
23212024-08-28T04:05:53.040ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23222024-08-28T04:05:53.040ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23232024-08-28T04:05:53.041ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23242024-08-28T04:05:53.042ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23252024-08-28T04:05:53.043ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23262024-08-28T04:05:53.043ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23272024-08-28T04:05:53.044ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23282024-08-28T04:05:53.044ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23292024-08-28T04:05:53.046ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23302024-08-28T04:05:53.047ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
23312024-08-28T04:05:53.047ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23322024-08-28T04:05:53.047ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23332024-08-28T04:05:53.048ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23342024-08-28T04:05:53.049ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02") } result = Ok(())
23352024-08-28T04:05:53.049ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23362024-08-28T04:05:53.050ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23372024-08-28T04:05:53.053ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23382024-08-28T04:05:53.054ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23392024-08-28T04:05:53.055ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23402024-08-28T04:05:53.055ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23412024-08-28T04:05:53.056ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23422024-08-28T04:05:53.056ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23432024-08-28T04:05:53.058ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23442024-08-28T04:05:53.058ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23452024-08-28T04:05:53.059ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23462024-08-28T04:05:53.060ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
23472024-08-28T04:05:53.060ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23482024-08-28T04:05:53.061ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23492024-08-28T04:05:53.062ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23502024-08-28T04:05:53.062ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23512024-08-28T04:05:53.063ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23522024-08-28T04:05:53.063ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23532024-08-28T04:05:53.064ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23542024-08-28T04:05:53.065ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) } result = Ok(())
23552024-08-28T04:05:53.066ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23562024-08-28T04:05:53.066ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23572024-08-28T04:05:53.068ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23582024-08-28T04:05:53.068ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23592024-08-28T04:05:53.078ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23602024-08-28T04:05:53.078ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23612024-08-28T04:05:53.081ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/system/ip-pools/default/silos
23622024-08-28T04:05:53.083ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 resource = IpPool { parent: Fleet, key: c81e4a0f-f03b-4dfd-9827-b6fe1844e865, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
23632024-08-28T04:05:53.083ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23642024-08-28T04:05:53.083ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23652024-08-28T04:05:53.085ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23662024-08-28T04:05:53.085ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23672024-08-28T04:05:53.087ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23682024-08-28T04:05:53.087ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23692024-08-28T04:05:53.090ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23702024-08-28T04:05:53.090ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23712024-08-28T04:05:53.092ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23722024-08-28T04:05:53.093ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23732024-08-28T04:05:53.095ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/system/ip-pools/default/silos
23742024-08-28T04:05:53.096ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
23752024-08-28T04:05:53.096ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23762024-08-28T04:05:53.096ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23772024-08-28T04:05:53.097ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23782024-08-28T04:05:53.098ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23792024-08-28T04:05:53.100ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/system/ip-pools/default/silos
23802024-08-28T04:05:53.102ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools/default/silos
23812024-08-28T04:05:53.102ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23822024-08-28T04:05:53.102ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23832024-08-28T04:05:53.148ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 112689 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = c5b5f2b0-1df4-40ed-8e5d-ec6421030214 response_code = 201 uri = /v1/system/ip-pools/default/silos
23842024-08-28T04:05:53.150ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23852024-08-28T04:05:53.150ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23862024-08-28T04:05:53.158ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23872024-08-28T04:05:53.159ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23882024-08-28T04:05:53.160ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23892024-08-28T04:05:53.161ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("token = \\"20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02\\"") } result = Ok(())
23902024-08-28T04:05:53.161ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23912024-08-28T04:05:53.161ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23922024-08-28T04:05:53.162ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23932024-08-28T04:05:53.162ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23942024-08-28T04:05:53.164ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23952024-08-28T04:05:53.164ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23962024-08-28T04:05:53.165ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23972024-08-28T04:05:53.165ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23982024-08-28T04:05:53.167ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23992024-08-28T04:05:53.168ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
24002024-08-28T04:05:53.168ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24012024-08-28T04:05:53.168ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24022024-08-28T04:05:53.169ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24032024-08-28T04:05:53.170ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02") } result = Ok(())
24042024-08-28T04:05:53.170ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24052024-08-28T04:05:53.170ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24062024-08-28T04:05:53.174ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24072024-08-28T04:05:53.174ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24082024-08-28T04:05:53.175ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24092024-08-28T04:05:53.176ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24102024-08-28T04:05:53.177ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24112024-08-28T04:05:53.177ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24122024-08-28T04:05:53.178ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24132024-08-28T04:05:53.178ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24142024-08-28T04:05:53.179ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24152024-08-28T04:05:53.181ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
24162024-08-28T04:05:53.181ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24172024-08-28T04:05:53.181ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24182024-08-28T04:05:53.182ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24192024-08-28T04:05:53.182ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24202024-08-28T04:05:53.183ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24212024-08-28T04:05:53.183ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24222024-08-28T04:05:53.185ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24232024-08-28T04:05:53.186ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) } result = Ok(())
24242024-08-28T04:05:53.186ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
24252024-08-28T04:05:53.186ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24262024-08-28T04:05:53.188ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
24272024-08-28T04:05:53.188ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24282024-08-28T04:05:53.190ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
24292024-08-28T04:05:53.190ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24302024-08-28T04:05:53.192ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
24312024-08-28T04:05:53.194ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 resource = IpPool { parent: Fleet, key: c81e4a0f-f03b-4dfd-9827-b6fe1844e865, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24322024-08-28T04:05:53.194ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
24332024-08-28T04:05:53.194ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24342024-08-28T04:05:53.195ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
24352024-08-28T04:05:53.196ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24362024-08-28T04:05:53.196ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
24372024-08-28T04:05:53.196ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24382024-08-28T04:05:53.198ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
24392024-08-28T04:05:53.198ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24402024-08-28T04:05:53.201ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
24412024-08-28T04:05:53.201ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 resource = IpPool { parent: Fleet, key: c81e4a0f-f03b-4dfd-9827-b6fe1844e865, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24422024-08-28T04:05:53.210ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 59625 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = d09cf5da-4eeb-4305-824d-8cbff60ede97 response_code = 201 uri = /v1/system/ip-pools/default/ranges/add
24432024-08-28T04:05:53.215ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24442024-08-28T04:05:53.215ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24452024-08-28T04:05:53.216ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24462024-08-28T04:05:53.217ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24472024-08-28T04:05:53.218ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24482024-08-28T04:05:53.219ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("token = \\"20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02\\"") } result = Ok(())
24492024-08-28T04:05:53.219ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24502024-08-28T04:05:53.219ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24512024-08-28T04:05:53.220ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24522024-08-28T04:05:53.220ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24532024-08-28T04:05:53.222ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24542024-08-28T04:05:53.222ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24552024-08-28T04:05:53.223ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24562024-08-28T04:05:53.224ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24572024-08-28T04:05:53.224ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24582024-08-28T04:05:53.226ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
24592024-08-28T04:05:53.226ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24602024-08-28T04:05:53.226ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24612024-08-28T04:05:53.227ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24622024-08-28T04:05:53.228ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02") } result = Ok(())
24632024-08-28T04:05:53.228ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24642024-08-28T04:05:53.228ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24652024-08-28T04:05:53.231ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24662024-08-28T04:05:53.232ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24672024-08-28T04:05:53.233ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24682024-08-28T04:05:53.233ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24692024-08-28T04:05:53.234ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24702024-08-28T04:05:53.234ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24712024-08-28T04:05:53.235ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24722024-08-28T04:05:53.235ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24732024-08-28T04:05:53.237ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24742024-08-28T04:05:53.238ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
24752024-08-28T04:05:53.238ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24762024-08-28T04:05:53.238ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24772024-08-28T04:05:53.239ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24782024-08-28T04:05:53.239ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24792024-08-28T04:05:53.241ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24802024-08-28T04:05:53.241ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24812024-08-28T04:05:53.242ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24822024-08-28T04:05:53.243ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) } result = Ok(())
24832024-08-28T04:05:53.243ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24842024-08-28T04:05:53.243ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24852024-08-28T04:05:53.244ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24862024-08-28T04:05:53.245ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24872024-08-28T04:05:53.247ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24882024-08-28T04:05:53.247ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24892024-08-28T04:05:53.249ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24902024-08-28T04:05:53.249ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24912024-08-28T04:05:53.251ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/system/silos/recovery/quotas
24922024-08-28T04:05:53.252ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
24932024-08-28T04:05:53.252ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24942024-08-28T04:05:53.252ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24952024-08-28T04:05:53.255ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24962024-08-28T04:05:53.255ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24972024-08-28T04:05:53.256ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24982024-08-28T04:05:53.256ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24992024-08-28T04:05:53.258ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/system/silos/recovery/quotas
25002024-08-28T04:05:53.259ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
25012024-08-28T04:05:53.259ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
25022024-08-28T04:05:53.260ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
25032024-08-28T04:05:53.264ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 48526 local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:32887 req_id = b3dcb8e6-9ba9-418e-b725-f8819a2600dc response_code = 200 uri = /v1/system/silos/recovery/quotas
25042024-08-28T04:05:53.266ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25052024-08-28T04:05:53.266ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25062024-08-28T04:05:53.267ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25072024-08-28T04:05:53.267ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25082024-08-28T04:05:53.269ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25092024-08-28T04:05:53.270ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("token = \\"20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02\\"") } result = Ok(())
25102024-08-28T04:05:53.270ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25112024-08-28T04:05:53.270ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25122024-08-28T04:05:53.271ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25132024-08-28T04:05:53.271ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25142024-08-28T04:05:53.272ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25152024-08-28T04:05:53.272ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25162024-08-28T04:05:53.274ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25172024-08-28T04:05:53.274ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25182024-08-28T04:05:53.275ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25192024-08-28T04:05:53.276ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
25202024-08-28T04:05:53.276ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25212024-08-28T04:05:53.276ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25222024-08-28T04:05:53.278ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25232024-08-28T04:05:53.279ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02") } result = Ok(())
25242024-08-28T04:05:53.279ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25252024-08-28T04:05:53.279ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25262024-08-28T04:05:53.282ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25272024-08-28T04:05:53.282ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25282024-08-28T04:05:53.283ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25292024-08-28T04:05:53.284ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25302024-08-28T04:05:53.285ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25312024-08-28T04:05:53.285ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25322024-08-28T04:05:53.286ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25332024-08-28T04:05:53.287ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25342024-08-28T04:05:53.288ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25352024-08-28T04:05:53.289ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
25362024-08-28T04:05:53.289ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25372024-08-28T04:05:53.289ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25382024-08-28T04:05:53.290ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25392024-08-28T04:05:53.290ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25402024-08-28T04:05:53.291ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25412024-08-28T04:05:53.291ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25422024-08-28T04:05:53.293ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25432024-08-28T04:05:53.294ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) } result = Ok(())
25442024-08-28T04:05:53.294ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = 0d027c2b-b557-4850-a4a8-b6cc48ed2c12 roles = RoleSet { roles: {} } uri = /v1/projects
25452024-08-28T04:05:53.294ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = 0d027c2b-b557-4850-a4a8-b6cc48ed2c12 resource = Database result = Ok(()) uri = /v1/projects
25462024-08-28T04:05:53.296ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = 0d027c2b-b557-4850-a4a8-b6cc48ed2c12 roles = RoleSet { roles: {} } uri = /v1/projects
25472024-08-28T04:05:53.296ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = 0d027c2b-b557-4850-a4a8-b6cc48ed2c12 resource = Database result = Ok(()) uri = /v1/projects
25482024-08-28T04:05:53.298ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = 0d027c2b-b557-4850-a4a8-b6cc48ed2c12 roles = RoleSet { roles: {} } uri = /v1/projects
25492024-08-28T04:05:53.298ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = 0d027c2b-b557-4850-a4a8-b6cc48ed2c12 resource = Database result = Ok(()) uri = /v1/projects
25502024-08-28T04:05:53.300ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = 0d027c2b-b557-4850-a4a8-b6cc48ed2c12 roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/projects
25512024-08-28T04:05:53.302ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = 0d027c2b-b557-4850-a4a8-b6cc48ed2c12 resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) } result = Ok(()) uri = /v1/projects
25522024-08-28T04:05:53.302ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create
25532024-08-28T04:05:53.302ZINFOnexus (SEC): saga create dag = {"end_node":17,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[2,3,null],[14,15,null],[16,0,null],[15,17,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"e3abc6f9-763c-486e-9205-7ca93e3777ea","lookup_type":{"ById":"e3abc6f9-763c-486e-9205-7ca93e3777ea"},"parent":null},"project_create":{"description":"","name":"proj-e61e86e5477"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","silo_user_id":"434f3819-8580-4baf-ad91-a501cc1bbc32"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"project-create","start_node":16} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25542024-08-28T04:05:53.302ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create
25552024-08-28T04:05:53.346ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create
25562024-08-28T04:05:53.346ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25572024-08-28T04:05:53.346ZDEBGnexus (SEC): saga log event new_state = N016 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25582024-08-28T04:05:53.346ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 16 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
25592024-08-28T04:05:53.355ZDEBGnexus (SEC): saga log event new_state = N016 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25602024-08-28T04:05:53.355ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 16 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
25612024-08-28T04:05:53.367ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25622024-08-28T04:05:53.367ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
25632024-08-28T04:05:53.384ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = ProjectCreateRecord
25642024-08-28T04:05:53.384ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = ProjectCreateRecord
25652024-08-28T04:05:53.386ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = ProjectCreateRecord
25662024-08-28T04:05:53.386ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = ProjectCreateRecord
25672024-08-28T04:05:53.389ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = ProjectCreateRecord
25682024-08-28T04:05:53.389ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = ProjectCreateRecord
25692024-08-28T04:05:53.392ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = ProjectCreateRecord
25702024-08-28T04:05:53.393ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) } result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = ProjectCreateRecord
25712024-08-28T04:05:53.393ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = ProjectCreateRecord
25722024-08-28T04:05:53.393ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = ProjectCreateRecord
25732024-08-28T04:05:53.405ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25742024-08-28T04:05:53.405ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "lookup_type": Object {"ByName": String("proj-e61e86e5477")}, "parent": Object {"key": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "lookup_type": Object {"ById": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "name": String("proj-e61e86e5477"), "time_created": String("2024-08-28T04:05:53.384364Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.384364Z")}, "rcgen": Number(1), "silo_id": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}]) node_id = 0 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
25752024-08-28T04:05:53.408ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25762024-08-28T04:05:53.408ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
25772024-08-28T04:05:53.416ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25782024-08-28T04:05:53.416ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "lookup_type": Object {"ByName": String("proj-e61e86e5477")}, "parent": Object {"key": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "lookup_type": Object {"ById": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "silo_user_id": String("434f3819-8580-4baf-ad91-a501cc1bbc32")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd2b:b1fd:30bd::/48"), "name": String("default")}}) node_id = 1 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
25792024-08-28T04:05:53.426ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25802024-08-28T04:05:53.426ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
25812024-08-28T04:05:53.429ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25822024-08-28T04:05:53.429ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
25832024-08-28T04:05:53.432ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25842024-08-28T04:05:53.432ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
25852024-08-28T04:05:53.435ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25862024-08-28T04:05:53.435ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("b1724e3f-3cff-478e-9b64-33e401bac27f")) node_id = 3 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
25872024-08-28T04:05:53.438ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25882024-08-28T04:05:53.438ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
25892024-08-28T04:05:53.442ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25902024-08-28T04:05:53.442ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("b1978a0b-0f2b-434b-bb59-99f4bffc2117")) node_id = 4 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
25912024-08-28T04:05:53.445ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25922024-08-28T04:05:53.445ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
25932024-08-28T04:05:53.449ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25942024-08-28T04:05:53.449ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("7227753d-9d93-4f73-8d32-6d4440932977")) node_id = 5 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
25952024-08-28T04:05:53.452ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25962024-08-28T04:05:53.452ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
25972024-08-28T04:05:53.455ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
25982024-08-28T04:05:53.455ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("b4f5fa7a-1d5c-4941-aac9-d1f8b3e16f74")) node_id = 6 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
25992024-08-28T04:05:53.458ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
26002024-08-28T04:05:53.458ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
26012024-08-28T04:05:53.461ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
26022024-08-28T04:05:53.461ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("63eb454c-b17c-4742-910e-a615e0fe2133")) node_id = 7 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
26032024-08-28T04:05:53.464ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
26042024-08-28T04:05:53.464ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
26052024-08-28T04:05:53.467ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateVpc
26062024-08-28T04:05:53.467ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateVpc
26072024-08-28T04:05:53.469ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateVpc
26082024-08-28T04:05:53.469ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateVpc
26092024-08-28T04:05:53.471ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateVpc
26102024-08-28T04:05:53.471ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateVpc
26112024-08-28T04:05:53.473ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateVpc
26122024-08-28T04:05:53.473ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateVpc
26132024-08-28T04:05:53.476ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateVpc
26142024-08-28T04:05:53.478ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ByName("proj-e61e86e5477") } result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateVpc
26152024-08-28T04:05:53.478ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateVpc
26162024-08-28T04:05:53.478ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateVpc
26172024-08-28T04:05:53.501ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
26182024-08-28T04:05:53.501ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("b1724e3f-3cff-478e-9b64-33e401bac27f"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "lookup_type": Object {"ByName": String("proj-e61e86e5477")}, "parent": Object {"key": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "lookup_type": Object {"ById": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("b1724e3f-3cff-478e-9b64-33e401bac27f"), "name": String("default"), "time_created": String("2024-08-28T04:05:53.467069Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.467069Z")}, "ipv6_prefix": String("fd2b:b1fd:30bd::/48"), "project_id": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "subnet_gen": Number(1), "system_router_id": String("b1978a0b-0f2b-434b-bb59-99f4bffc2117"), "vni": Number(3594149)}]) node_id = 8 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
26192024-08-28T04:05:53.505ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
26202024-08-28T04:05:53.505ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
26212024-08-28T04:05:53.510ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateRouter
26222024-08-28T04:05:53.510ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateRouter
26232024-08-28T04:05:53.513ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateRouter
26242024-08-28T04:05:53.513ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateRouter
26252024-08-28T04:05:53.515ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateRouter
26262024-08-28T04:05:53.515ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateRouter
26272024-08-28T04:05:53.518ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateRouter
26282024-08-28T04:05:53.518ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateRouter
26292024-08-28T04:05:53.519ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateRouter
26302024-08-28T04:05:53.522ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ByName("proj-e61e86e5477") }, key: b1724e3f-3cff-478e-9b64-33e401bac27f, lookup_type: ByName("default") } result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateRouter
26312024-08-28T04:05:53.522ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateRouter
26322024-08-28T04:05:53.522ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateRouter
26332024-08-28T04:05:53.526ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
26342024-08-28T04:05:53.526ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("b1978a0b-0f2b-434b-bb59-99f4bffc2117"), "lookup_type": Object {"ById": String("b1978a0b-0f2b-434b-bb59-99f4bffc2117")}, "parent": Object {"key": String("b1724e3f-3cff-478e-9b64-33e401bac27f"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "lookup_type": Object {"ByName": String("proj-e61e86e5477")}, "parent": Object {"key": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "lookup_type": Object {"ById": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}, "parent": Null}}}}) node_id = 9 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
26352024-08-28T04:05:53.529ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
26362024-08-28T04:05:53.529ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
26372024-08-28T04:05:53.533ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV4Route
26382024-08-28T04:05:53.533ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV4Route
26392024-08-28T04:05:53.535ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV4Route
26402024-08-28T04:05:53.535ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV4Route
26412024-08-28T04:05:53.537ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV4Route
26422024-08-28T04:05:53.537ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV4Route
26432024-08-28T04:05:53.539ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV4Route
26442024-08-28T04:05:53.539ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV4Route
26452024-08-28T04:05:53.541ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV4Route
26462024-08-28T04:05:53.544ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ByName("proj-e61e86e5477") }, key: b1724e3f-3cff-478e-9b64-33e401bac27f, lookup_type: ByName("default") }, key: b1978a0b-0f2b-434b-bb59-99f4bffc2117, lookup_type: ById(b1978a0b-0f2b-434b-bb59-99f4bffc2117) } result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV4Route
26472024-08-28T04:05:53.544ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV4Route
26482024-08-28T04:05:53.545ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV4Route
26492024-08-28T04:05:53.552ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
26502024-08-28T04:05:53.552ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
26512024-08-28T04:05:53.555ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
26522024-08-28T04:05:53.555ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
26532024-08-28T04:05:53.558ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV6Route
26542024-08-28T04:05:53.558ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV6Route
26552024-08-28T04:05:53.560ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV6Route
26562024-08-28T04:05:53.560ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV6Route
26572024-08-28T04:05:53.562ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV6Route
26582024-08-28T04:05:53.563ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV6Route
26592024-08-28T04:05:53.565ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV6Route
26602024-08-28T04:05:53.565ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV6Route
26612024-08-28T04:05:53.570ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV6Route
26622024-08-28T04:05:53.572ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ByName("proj-e61e86e5477") }, key: b1724e3f-3cff-478e-9b64-33e401bac27f, lookup_type: ByName("default") }, key: b1978a0b-0f2b-434b-bb59-99f4bffc2117, lookup_type: ById(b1978a0b-0f2b-434b-bb59-99f4bffc2117) } result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV6Route
26632024-08-28T04:05:53.572ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV6Route
26642024-08-28T04:05:53.572ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateV6Route
26652024-08-28T04:05:53.577ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
26662024-08-28T04:05:53.577ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
26672024-08-28T04:05:53.581ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
26682024-08-28T04:05:53.581ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
26692024-08-28T04:05:53.584ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateSubnet
26702024-08-28T04:05:53.584ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateSubnet
26712024-08-28T04:05:53.586ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateSubnet
26722024-08-28T04:05:53.586ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateSubnet
26732024-08-28T04:05:53.591ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateSubnet
26742024-08-28T04:05:53.591ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateSubnet
26752024-08-28T04:05:53.593ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateSubnet
26762024-08-28T04:05:53.593ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateSubnet
26772024-08-28T04:05:53.595ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateSubnet
26782024-08-28T04:05:53.598ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ByName("proj-e61e86e5477") }, key: b1724e3f-3cff-478e-9b64-33e401bac27f, lookup_type: ByName("default") } result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateSubnet
26792024-08-28T04:05:53.605ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateSubnet
26802024-08-28T04:05:53.605ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateSubnet
26812024-08-28T04:05:53.617ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateSubnet
26822024-08-28T04:05:53.617ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcCreateSubnet
26832024-08-28T04:05:53.621ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
26842024-08-28T04:05:53.621ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("63eb454c-b17c-4742-910e-a615e0fe2133"), "lookup_type": Object {"ById": String("63eb454c-b17c-4742-910e-a615e0fe2133")}, "parent": Object {"key": String("b1724e3f-3cff-478e-9b64-33e401bac27f"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "lookup_type": Object {"ByName": String("proj-e61e86e5477")}, "parent": Object {"key": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "lookup_type": Object {"ById": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("63eb454c-b17c-4742-910e-a615e0fe2133"), "name": String("default"), "time_created": String("2024-08-28T04:05:53.584518Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.584518Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd2b:b1fd:30bd::/64"), "rcgen": Number(1), "vpc_id": String("b1724e3f-3cff-478e-9b64-33e401bac27f")}]) node_id = 12 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
26852024-08-28T04:05:53.625ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
26862024-08-28T04:05:53.625ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
26872024-08-28T04:05:53.628ZDEBGnexus: default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 7680665e-d5c6-48aa-a3b9-dcb648202c5d, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2024-08-28T04:05:53.628769456Z, time_modified: 2024-08-28T04:05:53.628769456Z, time_deleted: None }, vpc_id: b1724e3f-3cff-478e-9b64-33e401bac27f, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 721c8563-e2d7-4310-acbd-b325ce74d393, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2024-08-28T04:05:53.628773886Z, time_modified: 2024-08-28T04:05:53.628773886Z, time_deleted: None }, vpc_id: b1724e3f-3cff-478e-9b64-33e401bac27f, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: ea5b0781-bef4-4f04-9528-ff7a3fb09623, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2024-08-28T04:05:53.628774886Z, time_modified: 2024-08-28T04:05:53.628774886Z, time_deleted: None }, vpc_id: b1724e3f-3cff-478e-9b64-33e401bac27f, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
26882024-08-28T04:05:53.628ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcUpdateFirewall
26892024-08-28T04:05:53.629ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcUpdateFirewall
26902024-08-28T04:05:53.631ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcUpdateFirewall
26912024-08-28T04:05:53.631ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcUpdateFirewall
26922024-08-28T04:05:53.633ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcUpdateFirewall
26932024-08-28T04:05:53.634ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcUpdateFirewall
26942024-08-28T04:05:53.636ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcUpdateFirewall
26952024-08-28T04:05:53.636ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcUpdateFirewall
26962024-08-28T04:05:53.638ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcUpdateFirewall
26972024-08-28T04:05:53.640ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ByName("proj-e61e86e5477") }, key: b1724e3f-3cff-478e-9b64-33e401bac27f, lookup_type: ByName("default") } result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcUpdateFirewall
26982024-08-28T04:05:53.640ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcUpdateFirewall
26992024-08-28T04:05:53.640ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcUpdateFirewall
27002024-08-28T04:05:53.690ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
27012024-08-28T04:05:53.690ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("7680665e-d5c6-48aa-a3b9-dcb648202c5d"), "name": String("allow-internal-inbound"), "time_created": String("2024-08-28T04:05:53.628769456Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.628769456Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("b1724e3f-3cff-478e-9b64-33e401bac27f")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("721c8563-e2d7-4310-acbd-b325ce74d393"), "name": String("allow-ssh"), "time_created": String("2024-08-28T04:05:53.628773886Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.628773886Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("b1724e3f-3cff-478e-9b64-33e401bac27f")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("ea5b0781-bef4-4f04-9528-ff7a3fb09623"), "name": String("allow-icmp"), "time_created": String("2024-08-28T04:05:53.628774886Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.628774886Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("b1724e3f-3cff-478e-9b64-33e401bac27f")}]) node_id = 13 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
27022024-08-28T04:05:53.695ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
27032024-08-28T04:05:53.695ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
27042024-08-28T04:05:53.698ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27052024-08-28T04:05:53.698ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27062024-08-28T04:05:53.700ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27072024-08-28T04:05:53.700ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27082024-08-28T04:05:53.701ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27092024-08-28T04:05:53.701ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27102024-08-28T04:05:53.703ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27112024-08-28T04:05:53.703ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27122024-08-28T04:05:53.705ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27132024-08-28T04:05:53.705ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27142024-08-28T04:05:53.708ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27152024-08-28T04:05:53.708ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27162024-08-28T04:05:53.710ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27172024-08-28T04:05:53.710ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27182024-08-28T04:05:53.712ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27192024-08-28T04:05:53.715ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ById(a16a488d-9cf3-46ab-854b-0c5f07eb0211) }, key: b1724e3f-3cff-478e-9b64-33e401bac27f, lookup_type: ByName("default") } result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27202024-08-28T04:05:53.715ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27212024-08-28T04:05:53.715ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27222024-08-28T04:05:53.717ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27232024-08-28T04:05:53.717ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27242024-08-28T04:05:53.719ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27252024-08-28T04:05:53.719ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27262024-08-28T04:05:53.722ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27272024-08-28T04:05:53.722ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27282024-08-28T04:05:53.724ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27292024-08-28T04:05:53.727ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ById(a16a488d-9cf3-46ab-854b-0c5f07eb0211) }, key: b1724e3f-3cff-478e-9b64-33e401bac27f, lookup_type: ByName("default") } result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27302024-08-28T04:05:53.727ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27312024-08-28T04:05:53.727ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_node = VpcNotifySleds
27322024-08-28T04:05:53.732ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
27332024-08-28T04:05:53.732ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = []
27342024-08-28T04:05:53.732ZDEBGnexus: resolved 0 rules for sleds
27352024-08-28T04:05:53.775ZDEBGnexus: resolved sleds for vpc default vpc_to_sled = []
27362024-08-28T04:05:53.775ZDEBGnexus: sending firewall rules to sled agents
27372024-08-28T04:05:53.775ZINFOnexus: updated firewall rules on 0 sleds file = nexus/networking/src/firewall_rules.rs:496
27382024-08-28T04:05:53.775ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
27392024-08-28T04:05:53.775ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
27402024-08-28T04:05:53.779ZDEBGnexus (SEC): saga log event new_state = N015 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
27412024-08-28T04:05:53.779ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 15 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
27422024-08-28T04:05:53.782ZDEBGnexus (SEC): saga log event new_state = N015 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
27432024-08-28T04:05:53.782ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 15 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
27442024-08-28T04:05:53.785ZDEBGnexus (SEC): saga log event new_state = N017 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
27452024-08-28T04:05:53.785ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 17 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
27462024-08-28T04:05:53.789ZDEBGnexus (SEC): saga log event new_state = N017 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
27472024-08-28T04:05:53.789ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 17 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
27482024-08-28T04:05:53.792ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
27492024-08-28T04:05:53.792ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = ec22ab10-df20-4322-b1d4-7795f8283836
27502024-08-28T04:05:53.837ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
27512024-08-28T04:05:53.837ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = ec22ab10-df20-4322-b1d4-7795f8283836 saga_name = project-create saga_result = SagaResult { saga_id: ec22ab10-df20-4322-b1d4-7795f8283836, saga_log: SagaLog { saga_id: ec22ab10-df20-4322-b1d4-7795f8283836, unwinding: false, events: [N016 started, N016 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N017 started, N017 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "lookup_type": Object {"ByName": String("proj-e61e86e5477")}, "parent": Object {"key": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "lookup_type": Object {"ById": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "name": String("proj-e61e86e5477"), "time_created": String("2024-08-28T04:05:53.384364Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.384364Z")}, "rcgen": Number(1), "silo_id": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "lookup_type": Object {"ByName": String("proj-e61e86e5477")}, "parent": Object {"key": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "lookup_type": Object {"ById": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "silo_user_id": String("434f3819-8580-4baf-ad91-a501cc1bbc32")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd2b:b1fd:30bd::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("b1724e3f-3cff-478e-9b64-33e401bac27f")), 4: Succeeded(String("b1978a0b-0f2b-434b-bb59-99f4bffc2117")), 5: Succeeded(String("7227753d-9d93-4f73-8d32-6d4440932977")), 6: Succeeded(String("b4f5fa7a-1d5c-4941-aac9-d1f8b3e16f74")), 7: Succeeded(String("63eb454c-b17c-4742-910e-a615e0fe2133")), 8: Succeeded(Array [Object {"key": String("b1724e3f-3cff-478e-9b64-33e401bac27f"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "lookup_type": Object {"ByName": String("proj-e61e86e5477")}, "parent": Object {"key": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "lookup_type": Object {"ById": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("b1724e3f-3cff-478e-9b64-33e401bac27f"), "name": String("default"), "time_created": String("2024-08-28T04:05:53.467069Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.467069Z")}, "ipv6_prefix": String("fd2b:b1fd:30bd::/48"), "project_id": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "subnet_gen": Number(1), "system_router_id": String("b1978a0b-0f2b-434b-bb59-99f4bffc2117"), "vni": Number(3594149)}]), 9: Succeeded(Object {"key": String("b1978a0b-0f2b-434b-bb59-99f4bffc2117"), "lookup_type": Object {"ById": String("b1978a0b-0f2b-434b-bb59-99f4bffc2117")}, "parent": Object {"key": String("b1724e3f-3cff-478e-9b64-33e401bac27f"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "lookup_type": Object {"ByName": String("proj-e61e86e5477")}, "parent": Object {"key": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "lookup_type": Object {"ById": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}, "parent": Null}}}}), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Array [Object {"key": String("63eb454c-b17c-4742-910e-a615e0fe2133"), "lookup_type": Object {"ById": String("63eb454c-b17c-4742-910e-a615e0fe2133")}, "parent": Object {"key": String("b1724e3f-3cff-478e-9b64-33e401bac27f"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "lookup_type": Object {"ByName": String("proj-e61e86e5477")}, "parent": Object {"key": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "lookup_type": Object {"ById": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("63eb454c-b17c-4742-910e-a615e0fe2133"), "name": String("default"), "time_created": String("2024-08-28T04:05:53.584518Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.584518Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd2b:b1fd:30bd::/64"), "rcgen": Number(1), "vpc_id": String("b1724e3f-3cff-478e-9b64-33e401bac27f")}]), 13: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("7680665e-d5c6-48aa-a3b9-dcb648202c5d"), "name": String("allow-internal-inbound"), "time_created": String("2024-08-28T04:05:53.628769456Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.628769456Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("b1724e3f-3cff-478e-9b64-33e401bac27f")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("721c8563-e2d7-4310-acbd-b325ce74d393"), "name": String("allow-ssh"), "time_created": String("2024-08-28T04:05:53.628773886Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.628773886Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("b1724e3f-3cff-478e-9b64-33e401bac27f")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("ea5b0781-bef4-4f04-9528-ff7a3fb09623"), "name": String("allow-icmp"), "time_created": String("2024-08-28T04:05:53.628774886Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.628774886Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("b1724e3f-3cff-478e-9b64-33e401bac27f")}]), 14: Succeeded(Null), 15: Succeeded(Null), 16: Succeeded(Null), 17: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_subnet_id": String("63eb454c-b17c-4742-910e-a615e0fe2133"), "default_v4_route_id": String("7227753d-9d93-4f73-8d32-6d4440932977"), "default_v6_route_id": String("b4f5fa7a-1d5c-4941-aac9-d1f8b3e16f74"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("7680665e-d5c6-48aa-a3b9-dcb648202c5d"), "name": String("allow-internal-inbound"), "time_created": String("2024-08-28T04:05:53.628769456Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.628769456Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("b1724e3f-3cff-478e-9b64-33e401bac27f")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("721c8563-e2d7-4310-acbd-b325ce74d393"), "name": String("allow-ssh"), "time_created": String("2024-08-28T04:05:53.628773886Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.628773886Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("b1724e3f-3cff-478e-9b64-33e401bac27f")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("ea5b0781-bef4-4f04-9528-ff7a3fb09623"), "name": String("allow-icmp"), "time_created": String("2024-08-28T04:05:53.628774886Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.628774886Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("b1724e3f-3cff-478e-9b64-33e401bac27f")}], "no_result": Null, "project": Array [Object {"key": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "lookup_type": Object {"ByName": String("proj-e61e86e5477")}, "parent": Object {"key": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "lookup_type": Object {"ById": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "name": String("proj-e61e86e5477"), "time_created": String("2024-08-28T04:05:53.384364Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.384364Z")}, "rcgen": Number(1), "silo_id": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}], "route4": Null, "route6": Null, "router": Object {"key": String("b1978a0b-0f2b-434b-bb59-99f4bffc2117"), "lookup_type": Object {"ById": String("b1978a0b-0f2b-434b-bb59-99f4bffc2117")}, "parent": Object {"key": String("b1724e3f-3cff-478e-9b64-33e401bac27f"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "lookup_type": Object {"ByName": String("proj-e61e86e5477")}, "parent": Object {"key": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "lookup_type": Object {"ById": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("63eb454c-b17c-4742-910e-a615e0fe2133"), "lookup_type": Object {"ById": String("63eb454c-b17c-4742-910e-a615e0fe2133")}, "parent": Object {"key": String("b1724e3f-3cff-478e-9b64-33e401bac27f"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "lookup_type": Object {"ByName": String("proj-e61e86e5477")}, "parent": Object {"key": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "lookup_type": Object {"ById": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("63eb454c-b17c-4742-910e-a615e0fe2133"), "name": String("default"), "time_created": String("2024-08-28T04:05:53.584518Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.584518Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd2b:b1fd:30bd::/64"), "rcgen": Number(1), "vpc_id": String("b1724e3f-3cff-478e-9b64-33e401bac27f")}], "system_router_id": String("b1978a0b-0f2b-434b-bb59-99f4bffc2117"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "lookup_type": Object {"ByName": String("proj-e61e86e5477")}, "parent": Object {"key": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "lookup_type": Object {"ById": String("e3abc6f9-763c-486e-9205-7ca93e3777ea")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "silo_user_id": String("434f3819-8580-4baf-ad91-a501cc1bbc32")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd2b:b1fd:30bd::/48"), "name": String("default")}}, "vpc_id": String("b1724e3f-3cff-478e-9b64-33e401bac27f")} }) }
27522024-08-28T04:05:53.838ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 572932 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = 0d027c2b-b557-4850-a4a8-b6cc48ed2c12 response_code = 201 uri = /v1/projects
27532024-08-28T04:05:53.842ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27542024-08-28T04:05:53.843ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27552024-08-28T04:05:53.844ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27562024-08-28T04:05:53.844ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27572024-08-28T04:05:53.846ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27582024-08-28T04:05:53.847ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("token = \\"20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02\\"") } result = Ok(())
27592024-08-28T04:05:53.847ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27602024-08-28T04:05:53.847ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27612024-08-28T04:05:53.848ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27622024-08-28T04:05:53.849ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27632024-08-28T04:05:53.850ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27642024-08-28T04:05:53.850ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27652024-08-28T04:05:53.852ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27662024-08-28T04:05:53.852ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27672024-08-28T04:05:53.853ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27682024-08-28T04:05:53.854ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
27692024-08-28T04:05:53.854ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27702024-08-28T04:05:53.854ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27712024-08-28T04:05:53.855ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27722024-08-28T04:05:53.856ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02") } result = Ok(())
27732024-08-28T04:05:53.856ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27742024-08-28T04:05:53.857ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27752024-08-28T04:05:53.860ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27762024-08-28T04:05:53.860ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27772024-08-28T04:05:53.862ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27782024-08-28T04:05:53.862ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27792024-08-28T04:05:53.863ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27802024-08-28T04:05:53.863ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27812024-08-28T04:05:53.864ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27822024-08-28T04:05:53.864ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27832024-08-28T04:05:53.865ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27842024-08-28T04:05:53.867ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
27852024-08-28T04:05:53.867ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27862024-08-28T04:05:53.867ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27872024-08-28T04:05:53.868ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27882024-08-28T04:05:53.868ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27892024-08-28T04:05:53.869ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27902024-08-28T04:05:53.870ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27912024-08-28T04:05:53.871ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27922024-08-28T04:05:53.872ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) } result = Ok(())
27932024-08-28T04:05:53.872ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = f999a0d2-ccbc-4628-9961-a7bbeb7fdde6 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-e61e86e5477
27942024-08-28T04:05:53.872ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = f999a0d2-ccbc-4628-9961-a7bbeb7fdde6 resource = Database result = Ok(()) uri = /v1/disks?project=proj-e61e86e5477
27952024-08-28T04:05:53.873ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = f999a0d2-ccbc-4628-9961-a7bbeb7fdde6 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-e61e86e5477
27962024-08-28T04:05:53.874ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = f999a0d2-ccbc-4628-9961-a7bbeb7fdde6 resource = Database result = Ok(()) uri = /v1/disks?project=proj-e61e86e5477
27972024-08-28T04:05:53.875ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = f999a0d2-ccbc-4628-9961-a7bbeb7fdde6 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-e61e86e5477
27982024-08-28T04:05:53.875ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = f999a0d2-ccbc-4628-9961-a7bbeb7fdde6 resource = Database result = Ok(()) uri = /v1/disks?project=proj-e61e86e5477
27992024-08-28T04:05:53.877ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = f999a0d2-ccbc-4628-9961-a7bbeb7fdde6 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-e61e86e5477
28002024-08-28T04:05:53.878ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = f999a0d2-ccbc-4628-9961-a7bbeb7fdde6 resource = Database result = Ok(()) uri = /v1/disks?project=proj-e61e86e5477
28012024-08-28T04:05:53.880ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = f999a0d2-ccbc-4628-9961-a7bbeb7fdde6 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-e61e86e5477
28022024-08-28T04:05:53.880ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = f999a0d2-ccbc-4628-9961-a7bbeb7fdde6 resource = Database result = Ok(()) uri = /v1/disks?project=proj-e61e86e5477
28032024-08-28T04:05:53.882ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = f999a0d2-ccbc-4628-9961-a7bbeb7fdde6 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-e61e86e5477
28042024-08-28T04:05:53.882ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = f999a0d2-ccbc-4628-9961-a7bbeb7fdde6 resource = Database result = Ok(()) uri = /v1/disks?project=proj-e61e86e5477
28052024-08-28T04:05:53.887ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = f999a0d2-ccbc-4628-9961-a7bbeb7fdde6 roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/disks?project=proj-e61e86e5477
28062024-08-28T04:05:53.889ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = f999a0d2-ccbc-4628-9961-a7bbeb7fdde6 resource = Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ByName("proj-e61e86e5477") } result = Ok(()) uri = /v1/disks?project=proj-e61e86e5477
28072024-08-28T04:05:53.889ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create
28082024-08-28T04:05:53.889ZINFOnexus (SEC): saga create dag = {"end_node":10,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,0,null],[8,10,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateDiskId","name":"disk_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVolumeId","name":"volume_id"}},{"Action":{"action_name":"disk_create.create_disk_record","label":"CreateDiskRecord","name":"created_disk"}},{"Action":{"action_name":"disk_create.regions_alloc","label":"RegionsAlloc","name":"datasets_and_regions"}},{"Action":{"action_name":"disk_create.space_account","label":"SpaceAccount","name":"no_result"}},{"Action":{"action_name":"disk_create.regions_ensure_undo","label":"RegionsEnsureUndo","name":"regions_ensure_undo"}},{"Action":{"action_name":"disk_create.regions_ensure","label":"RegionsEnsure","name":"regions_ensure"}},{"Action":{"action_name":"disk_create.create_volume_record","label":"CreateVolumeRecord","name":"created_volume"}},{"Action":{"action_name":"disk_create.finalize_disk_record","label":"FinalizeDiskRecord","name":"disk_runtime"}},{"Start":{"params":{"create_params":{"description":"","disk_source":{"block_size":512,"type":"blank"},"name":"disk-156ca3a8eae","size":1073741824},"project_id":"a16a488d-9cf3-46ab-854b-0c5f07eb0211","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","silo_user_id":"434f3819-8580-4baf-ad91-a501cc1bbc32"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"disk-create","start_node":9} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28092024-08-28T04:05:53.889ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create
28102024-08-28T04:05:53.916ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create
28112024-08-28T04:05:53.916ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28122024-08-28T04:05:53.916ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28132024-08-28T04:05:53.916ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28142024-08-28T04:05:53.919ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28152024-08-28T04:05:53.919ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28162024-08-28T04:05:53.923ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28172024-08-28T04:05:53.923ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28182024-08-28T04:05:53.926ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28192024-08-28T04:05:53.926ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("f4a23c2c-5cf4-474d-8350-852432b82d4d")) node_id = 0 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28202024-08-28T04:05:53.929ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28212024-08-28T04:05:53.929ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28222024-08-28T04:05:53.933ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28232024-08-28T04:05:53.933ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("9311a212-fa55-4773-99aa-3f47dfa7f07e")) node_id = 1 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28242024-08-28T04:05:53.936ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28252024-08-28T04:05:53.936ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28262024-08-28T04:05:53.939ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28272024-08-28T04:05:53.940ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28282024-08-28T04:05:53.941ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28292024-08-28T04:05:53.941ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28302024-08-28T04:05:53.942ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28312024-08-28T04:05:53.942ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28322024-08-28T04:05:53.944ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28332024-08-28T04:05:53.944ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28342024-08-28T04:05:53.946ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28352024-08-28T04:05:53.946ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28362024-08-28T04:05:53.949ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28372024-08-28T04:05:53.949ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28382024-08-28T04:05:53.951ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28392024-08-28T04:05:53.953ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ById(a16a488d-9cf3-46ab-854b-0c5f07eb0211) } result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28402024-08-28T04:05:53.953ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28412024-08-28T04:05:53.953ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28422024-08-28T04:05:53.956ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28432024-08-28T04:05:53.956ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28442024-08-28T04:05:53.958ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28452024-08-28T04:05:53.958ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28462024-08-28T04:05:53.960ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28472024-08-28T04:05:53.960ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28482024-08-28T04:05:53.962ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28492024-08-28T04:05:53.965ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ById(a16a488d-9cf3-46ab-854b-0c5f07eb0211) } result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28502024-08-28T04:05:53.965ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28512024-08-28T04:05:53.965ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = CreateDiskRecord
28522024-08-28T04:05:54.010ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28532024-08-28T04:05:54.010ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("f4a23c2c-5cf4-474d-8350-852432b82d4d"), "name": String("disk-156ca3a8eae"), "time_created": String("2024-08-28T04:05:53.939959Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.939959Z")}, "pantry_address": Null, "project_id": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-08-28T04:05:53.939959Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}) node_id = 2 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28542024-08-28T04:05:54.016ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28552024-08-28T04:05:54.016ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28562024-08-28T04:05:54.021ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = RegionsAlloc
28572024-08-28T04:05:54.021ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = RegionsAlloc
28582024-08-28T04:05:54.076ZINFOnexus (datastore): Allocated regions for volume datasets_and_regions = [(Dataset { identity: DatasetIdentity { id: d073ae9b-afee-401e-bafb-45a05ad31f0d, time_created: 2024-08-28T04:05:49.286949Z, time_modified: 2024-08-28T04:05:49.286949Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 8955d8a9-1b85-47ea-bd5c-275ef6dc0b1a, ip: Some(fd00:1122:3344:101::15), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824) }, Region { identity: RegionIdentity { id: 287208c2-b875-4424-a33b-4feae8ca3da9, time_created: 2024-08-28T04:05:54.034121Z, time_modified: 2024-08-28T04:05:54.034121Z }, dataset_id: d073ae9b-afee-401e-bafb-45a05ad31f0d, volume_id: 9311a212-fa55-4773-99aa-3f47dfa7f07e, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false }), (Dataset { identity: DatasetIdentity { id: d6ce85cc-4f25-4b5e-b0c0-a434368f63d4, time_created: 2024-08-28T04:05:49.286949Z, time_modified: 2024-08-28T04:05:49.286949Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: d6170dc9-a1d4-44a9-ba24-00c07a403b1e, ip: Some(fd00:1122:3344:101::14), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824) }, Region { identity: RegionIdentity { id: e7c7d85c-9fdf-4b83-b8e2-1c2fe6bcfd42, time_created: 2024-08-28T04:05:54.034121Z, time_modified: 2024-08-28T04:05:54.034121Z }, dataset_id: d6ce85cc-4f25-4b5e-b0c0-a434368f63d4, volume_id: 9311a212-fa55-4773-99aa-3f47dfa7f07e, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false }), (Dataset { identity: DatasetIdentity { id: ff9eaaaf-6eec-47be-bc80-11d83c51090f, time_created: 2024-08-28T04:05:49.286950Z, time_modified: 2024-08-28T04:05:49.286950Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: fb7c10cb-4fd0-49dd-8c21-f83feafbd7dc, ip: Some(fd00:1122:3344:101::16), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824) }, Region { identity: RegionIdentity { id: 4fadbffa-b011-435b-8547-fc32166084cf, time_created: 2024-08-28T04:05:54.034121Z, time_modified: 2024-08-28T04:05:54.034121Z }, dataset_id: ff9eaaaf-6eec-47be-bc80-11d83c51090f, volume_id: 9311a212-fa55-4773-99aa-3f47dfa7f07e, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false })] file = nexus/db-queries/src/db/datastore/region.rs:280 maybe_snapshot_id = None volume_id = 9311a212-fa55-4773-99aa-3f47dfa7f07e
28592024-08-28T04:05:54.076ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28602024-08-28T04:05:54.076ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Array [Object {"identity": Object {"id": String("d073ae9b-afee-401e-bafb-45a05ad31f0d"), "time_created": String("2024-08-28T04:05:49.286949Z"), "time_modified": String("2024-08-28T04:05:49.286949Z")}, "ip": String("fd00:1122:3344:101::15"), "kind": String("Crucible"), "pool_id": String("8955d8a9-1b85-47ea-bd5c-275ef6dc0b1a"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("d073ae9b-afee-401e-bafb-45a05ad31f0d"), "extent_count": Number(16), "identity": Object {"id": String("287208c2-b875-4424-a33b-4feae8ca3da9"), "time_created": String("2024-08-28T04:05:54.034121Z"), "time_modified": String("2024-08-28T04:05:54.034121Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}], Array [Object {"identity": Object {"id": String("d6ce85cc-4f25-4b5e-b0c0-a434368f63d4"), "time_created": String("2024-08-28T04:05:49.286949Z"), "time_modified": String("2024-08-28T04:05:49.286949Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("d6170dc9-a1d4-44a9-ba24-00c07a403b1e"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("d6ce85cc-4f25-4b5e-b0c0-a434368f63d4"), "extent_count": Number(16), "identity": Object {"id": String("e7c7d85c-9fdf-4b83-b8e2-1c2fe6bcfd42"), "time_created": String("2024-08-28T04:05:54.034121Z"), "time_modified": String("2024-08-28T04:05:54.034121Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}], Array [Object {"identity": Object {"id": String("ff9eaaaf-6eec-47be-bc80-11d83c51090f"), "time_created": String("2024-08-28T04:05:49.286950Z"), "time_modified": String("2024-08-28T04:05:49.286950Z")}, "ip": String("fd00:1122:3344:101::16"), "kind": String("Crucible"), "pool_id": String("fb7c10cb-4fd0-49dd-8c21-f83feafbd7dc"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("ff9eaaaf-6eec-47be-bc80-11d83c51090f"), "extent_count": Number(16), "identity": Object {"id": String("4fadbffa-b011-435b-8547-fc32166084cf"), "time_created": String("2024-08-28T04:05:54.034121Z"), "time_modified": String("2024-08-28T04:05:54.034121Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}]]) node_id = 3 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28612024-08-28T04:05:54.080ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28622024-08-28T04:05:54.081ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28632024-08-28T04:05:54.084ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = SpaceAccount
28642024-08-28T04:05:54.084ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = SpaceAccount
28652024-08-28T04:05:54.114ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28662024-08-28T04:05:54.114ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28672024-08-28T04:05:54.119ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28682024-08-28T04:05:54.119ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28692024-08-28T04:05:54.127ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28702024-08-28T04:05:54.127ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28712024-08-28T04:05:54.130ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28722024-08-28T04:05:54.130ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28732024-08-28T04:05:54.165ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 307.334664ms dataset = d6ce85cc-4f25-4b5e-b0c0-a434368f63d4 file = nexus/src/app/crucible.rs:230 region = e7c7d85c-9fdf-4b83-b8e2-1c2fe6bcfd42 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create
28742024-08-28T04:05:54.168ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 162.191935ms dataset = d073ae9b-afee-401e-bafb-45a05ad31f0d file = nexus/src/app/crucible.rs:230 region = 287208c2-b875-4424-a33b-4feae8ca3da9 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create
28752024-08-28T04:05:54.170ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 346.560371ms dataset = ff9eaaaf-6eec-47be-bc80-11d83c51090f file = nexus/src/app/crucible.rs:230 region = 4fadbffa-b011-435b-8547-fc32166084cf saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create
28762024-08-28T04:05:54.337ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 464.740878ms dataset = d073ae9b-afee-401e-bafb-45a05ad31f0d file = nexus/src/app/crucible.rs:230 region = 287208c2-b875-4424-a33b-4feae8ca3da9 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create
28772024-08-28T04:05:54.822ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28782024-08-28T04:05:54.822ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"f4a23c2c-5cf4-474d-8350-852432b82d4d\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"f4a23c2c-5cf4-474d-8350-852432b82d4d\\",\\"key\\":\\"qvB41s7wI/l9CqGWTa9v5r4CnOlUEu1ISRQTWxRgtgk=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::14]:19000\\",\\"[fd00:1122:3344:101::16]:19000\\",\\"[fd00:1122:3344:101::15]:19000\\"]}}]}")) node_id = 6 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28792024-08-28T04:05:54.825ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28802024-08-28T04:05:54.825ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28812024-08-28T04:05:54.841ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28822024-08-28T04:05:54.841ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28832024-08-28T04:05:54.845ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
28842024-08-28T04:05:54.845ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
28852024-08-28T04:05:54.849ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
28862024-08-28T04:05:54.849ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
28872024-08-28T04:05:54.859ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
28882024-08-28T04:05:54.859ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
28892024-08-28T04:05:54.860ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
28902024-08-28T04:05:54.860ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
28912024-08-28T04:05:54.865ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
28922024-08-28T04:05:54.865ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
28932024-08-28T04:05:54.867ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
28942024-08-28T04:05:54.868ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
28952024-08-28T04:05:54.870ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
28962024-08-28T04:05:54.870ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
28972024-08-28T04:05:54.872ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
28982024-08-28T04:05:54.872ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
28992024-08-28T04:05:54.874ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
29002024-08-28T04:05:54.877ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ById(a16a488d-9cf3-46ab-854b-0c5f07eb0211) }, key: f4a23c2c-5cf4-474d-8350-852432b82d4d, lookup_type: ById(f4a23c2c-5cf4-474d-8350-852432b82d4d) } result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
29012024-08-28T04:05:54.877ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
29022024-08-28T04:05:54.877ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
29032024-08-28T04:05:54.879ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
29042024-08-28T04:05:54.880ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
29052024-08-28T04:05:54.882ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
29062024-08-28T04:05:54.882ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
29072024-08-28T04:05:54.884ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
29082024-08-28T04:05:54.884ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
29092024-08-28T04:05:54.887ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
29102024-08-28T04:05:54.889ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ById(a16a488d-9cf3-46ab-854b-0c5f07eb0211) }, key: f4a23c2c-5cf4-474d-8350-852432b82d4d, lookup_type: ById(f4a23c2c-5cf4-474d-8350-852432b82d4d) } result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
29112024-08-28T04:05:54.889ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
29122024-08-28T04:05:54.889ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_node = FinalizeDiskRecord
29132024-08-28T04:05:54.902ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
29142024-08-28T04:05:54.902ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
29152024-08-28T04:05:54.906ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
29162024-08-28T04:05:54.906ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
29172024-08-28T04:05:54.909ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
29182024-08-28T04:05:54.909ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
29192024-08-28T04:05:54.912ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
29202024-08-28T04:05:54.912ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11
29212024-08-28T04:05:54.949ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
29222024-08-28T04:05:54.949ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = e6008350-f0f1-49f8-bafa-2998fcbfad11 saga_name = disk-create saga_result = SagaResult { saga_id: e6008350-f0f1-49f8-bafa-2998fcbfad11, saga_log: SagaLog { saga_id: e6008350-f0f1-49f8-bafa-2998fcbfad11, unwinding: false, events: [N009 started, N009 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N010 started, N010 succeeded], node_status: {0: Succeeded(String("f4a23c2c-5cf4-474d-8350-852432b82d4d")), 1: Succeeded(String("9311a212-fa55-4773-99aa-3f47dfa7f07e")), 2: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("f4a23c2c-5cf4-474d-8350-852432b82d4d"), "name": String("disk-156ca3a8eae"), "time_created": String("2024-08-28T04:05:53.939959Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.939959Z")}, "pantry_address": Null, "project_id": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-08-28T04:05:53.939959Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}), 3: Succeeded(Array [Array [Object {"identity": Object {"id": String("d073ae9b-afee-401e-bafb-45a05ad31f0d"), "time_created": String("2024-08-28T04:05:49.286949Z"), "time_modified": String("2024-08-28T04:05:49.286949Z")}, "ip": String("fd00:1122:3344:101::15"), "kind": String("Crucible"), "pool_id": String("8955d8a9-1b85-47ea-bd5c-275ef6dc0b1a"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("d073ae9b-afee-401e-bafb-45a05ad31f0d"), "extent_count": Number(16), "identity": Object {"id": String("287208c2-b875-4424-a33b-4feae8ca3da9"), "time_created": String("2024-08-28T04:05:54.034121Z"), "time_modified": String("2024-08-28T04:05:54.034121Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}], Array [Object {"identity": Object {"id": String("d6ce85cc-4f25-4b5e-b0c0-a434368f63d4"), "time_created": String("2024-08-28T04:05:49.286949Z"), "time_modified": String("2024-08-28T04:05:49.286949Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("d6170dc9-a1d4-44a9-ba24-00c07a403b1e"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("d6ce85cc-4f25-4b5e-b0c0-a434368f63d4"), "extent_count": Number(16), "identity": Object {"id": String("e7c7d85c-9fdf-4b83-b8e2-1c2fe6bcfd42"), "time_created": String("2024-08-28T04:05:54.034121Z"), "time_modified": String("2024-08-28T04:05:54.034121Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}], Array [Object {"identity": Object {"id": String("ff9eaaaf-6eec-47be-bc80-11d83c51090f"), "time_created": String("2024-08-28T04:05:49.286950Z"), "time_modified": String("2024-08-28T04:05:49.286950Z")}, "ip": String("fd00:1122:3344:101::16"), "kind": String("Crucible"), "pool_id": String("fb7c10cb-4fd0-49dd-8c21-f83feafbd7dc"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("ff9eaaaf-6eec-47be-bc80-11d83c51090f"), "extent_count": Number(16), "identity": Object {"id": String("4fadbffa-b011-435b-8547-fc32166084cf"), "time_created": String("2024-08-28T04:05:54.034121Z"), "time_modified": String("2024-08-28T04:05:54.034121Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}]]), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"f4a23c2c-5cf4-474d-8350-852432b82d4d\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"f4a23c2c-5cf4-474d-8350-852432b82d4d\\",\\"key\\":\\"qvB41s7wI/l9CqGWTa9v5r4CnOlUEu1ISRQTWxRgtgk=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::14]:19000\\",\\"[fd00:1122:3344:101::16]:19000\\",\\"[fd00:1122:3344:101::15]:19000\\"]}}]}")), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"created_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("f4a23c2c-5cf4-474d-8350-852432b82d4d"), "name": String("disk-156ca3a8eae"), "time_created": String("2024-08-28T04:05:53.939959Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.939959Z")}, "pantry_address": Null, "project_id": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-08-28T04:05:53.939959Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}, "created_volume": Null, "datasets_and_regions": Array [Array [Object {"identity": Object {"id": String("d073ae9b-afee-401e-bafb-45a05ad31f0d"), "time_created": String("2024-08-28T04:05:49.286949Z"), "time_modified": String("2024-08-28T04:05:49.286949Z")}, "ip": String("fd00:1122:3344:101::15"), "kind": String("Crucible"), "pool_id": String("8955d8a9-1b85-47ea-bd5c-275ef6dc0b1a"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("d073ae9b-afee-401e-bafb-45a05ad31f0d"), "extent_count": Number(16), "identity": Object {"id": String("287208c2-b875-4424-a33b-4feae8ca3da9"), "time_created": String("2024-08-28T04:05:54.034121Z"), "time_modified": String("2024-08-28T04:05:54.034121Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}], Array [Object {"identity": Object {"id": String("d6ce85cc-4f25-4b5e-b0c0-a434368f63d4"), "time_created": String("2024-08-28T04:05:49.286949Z"), "time_modified": String("2024-08-28T04:05:49.286949Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("d6170dc9-a1d4-44a9-ba24-00c07a403b1e"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("d6ce85cc-4f25-4b5e-b0c0-a434368f63d4"), "extent_count": Number(16), "identity": Object {"id": String("e7c7d85c-9fdf-4b83-b8e2-1c2fe6bcfd42"), "time_created": String("2024-08-28T04:05:54.034121Z"), "time_modified": String("2024-08-28T04:05:54.034121Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}], Array [Object {"identity": Object {"id": String("ff9eaaaf-6eec-47be-bc80-11d83c51090f"), "time_created": String("2024-08-28T04:05:49.286950Z"), "time_modified": String("2024-08-28T04:05:49.286950Z")}, "ip": String("fd00:1122:3344:101::16"), "kind": String("Crucible"), "pool_id": String("fb7c10cb-4fd0-49dd-8c21-f83feafbd7dc"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("ff9eaaaf-6eec-47be-bc80-11d83c51090f"), "extent_count": Number(16), "identity": Object {"id": String("4fadbffa-b011-435b-8547-fc32166084cf"), "time_created": String("2024-08-28T04:05:54.034121Z"), "time_modified": String("2024-08-28T04:05:54.034121Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}]], "disk_id": String("f4a23c2c-5cf4-474d-8350-852432b82d4d"), "disk_runtime": Null, "no_result": Null, "regions_ensure": String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"f4a23c2c-5cf4-474d-8350-852432b82d4d\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"f4a23c2c-5cf4-474d-8350-852432b82d4d\\",\\"key\\":\\"qvB41s7wI/l9CqGWTa9v5r4CnOlUEu1ISRQTWxRgtgk=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::14]:19000\\",\\"[fd00:1122:3344:101::16]:19000\\",\\"[fd00:1122:3344:101::15]:19000\\"]}}]}"), "regions_ensure_undo": Null, "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")} }) }
29232024-08-28T04:05:54.949ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1107993 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = f999a0d2-ccbc-4628-9961-a7bbeb7fdde6 response_code = 201 uri = /v1/disks?project=proj-e61e86e5477
29242024-08-28T04:05:54.952ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29252024-08-28T04:05:54.952ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29262024-08-28T04:05:54.953ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29272024-08-28T04:05:54.953ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29282024-08-28T04:05:54.955ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29292024-08-28T04:05:54.956ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("token = \\"20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02\\"") } result = Ok(())
29302024-08-28T04:05:54.956ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29312024-08-28T04:05:54.956ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29322024-08-28T04:05:54.957ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29332024-08-28T04:05:54.958ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29342024-08-28T04:05:54.959ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29352024-08-28T04:05:54.959ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29362024-08-28T04:05:54.960ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29372024-08-28T04:05:54.961ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29382024-08-28T04:05:54.962ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29392024-08-28T04:05:54.963ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
29402024-08-28T04:05:54.963ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29412024-08-28T04:05:54.963ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29422024-08-28T04:05:54.964ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29432024-08-28T04:05:54.965ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02") } result = Ok(())
29442024-08-28T04:05:54.965ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29452024-08-28T04:05:54.965ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29462024-08-28T04:05:54.969ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29472024-08-28T04:05:54.969ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29482024-08-28T04:05:54.971ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29492024-08-28T04:05:54.971ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29502024-08-28T04:05:54.972ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29512024-08-28T04:05:54.972ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29522024-08-28T04:05:54.973ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29532024-08-28T04:05:54.973ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29542024-08-28T04:05:54.975ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29552024-08-28T04:05:54.976ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
29562024-08-28T04:05:54.976ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29572024-08-28T04:05:54.976ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29582024-08-28T04:05:54.977ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29592024-08-28T04:05:54.977ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29602024-08-28T04:05:54.979ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29612024-08-28T04:05:54.979ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29622024-08-28T04:05:54.980ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29632024-08-28T04:05:54.981ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) } result = Ok(())
29642024-08-28T04:05:54.981ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 roles = RoleSet { roles: {} } uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29652024-08-28T04:05:54.981ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 resource = Database result = Ok(()) uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29662024-08-28T04:05:54.982ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 roles = RoleSet { roles: {} } uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29672024-08-28T04:05:54.982ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 resource = Database result = Ok(()) uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29682024-08-28T04:05:54.985ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 roles = RoleSet { roles: {} } uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29692024-08-28T04:05:54.985ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 resource = Database result = Ok(()) uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29702024-08-28T04:05:54.988ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 roles = RoleSet { roles: {} } uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29712024-08-28T04:05:54.988ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 resource = Database result = Ok(()) uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29722024-08-28T04:05:54.990ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 roles = RoleSet { roles: {} } uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29732024-08-28T04:05:54.990ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 resource = Database result = Ok(()) uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29742024-08-28T04:05:54.992ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 roles = RoleSet { roles: {} } uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29752024-08-28T04:05:54.992ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 resource = Database result = Ok(()) uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29762024-08-28T04:05:54.994ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 roles = RoleSet { roles: {} } uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29772024-08-28T04:05:54.994ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 resource = Database result = Ok(()) uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29782024-08-28T04:05:54.997ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29792024-08-28T04:05:54.999ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ByName("proj-e61e86e5477") }, key: f4a23c2c-5cf4-474d-8350-852432b82d4d, lookup_type: ByName("disk-156ca3a8eae") } result = Ok(()) uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29802024-08-28T04:05:54.999ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 roles = RoleSet { roles: {} } uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29812024-08-28T04:05:54.999ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 resource = Database result = Ok(()) uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29822024-08-28T04:05:55.001ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 roles = RoleSet { roles: {} } uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29832024-08-28T04:05:55.001ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 resource = Database result = Ok(()) uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29842024-08-28T04:05:55.002ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 roles = RoleSet { roles: {} } uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29852024-08-28T04:05:55.003ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 resource = Database result = Ok(()) uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29862024-08-28T04:05:55.004ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 roles = RoleSet { roles: {} } uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29872024-08-28T04:05:55.004ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 resource = Database result = Ok(()) uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29882024-08-28T04:05:55.005ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 roles = RoleSet { roles: {} } uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29892024-08-28T04:05:55.005ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 resource = Database result = Ok(()) uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29902024-08-28T04:05:55.008ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 roles = RoleSet { roles: {} } uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29912024-08-28T04:05:55.008ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 resource = Database result = Ok(()) uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29922024-08-28T04:05:55.010ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 roles = RoleSet { roles: {} } uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29932024-08-28T04:05:55.010ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 resource = Database result = Ok(()) uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29942024-08-28T04:05:55.013ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29952024-08-28T04:05:55.015ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ById(a16a488d-9cf3-46ab-854b-0c5f07eb0211) }, key: f4a23c2c-5cf4-474d-8350-852432b82d4d, lookup_type: ById(f4a23c2c-5cf4-474d-8350-852432b82d4d) } result = Ok(()) uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
29962024-08-28T04:05:55.016ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9 saga_name = disk-delete
29972024-08-28T04:05:55.016ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[3,4,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","silo_user_id":"434f3819-8580-4baf-ad91-a501cc1bbc32"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"9311a212-fa55-4773-99aa-3f47dfa7f07e"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"final_no_result"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"f4a23c2c-5cf4-474d-8350-852432b82d4d","project_id":"a16a488d-9cf3-46ab-854b-0c5f07eb0211","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","silo_user_id":"434f3819-8580-4baf-ad91-a501cc1bbc32"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"9311a212-fa55-4773-99aa-3f47dfa7f07e"}}},"End"]},"saga_name":"disk-delete","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9 saga_name = disk-delete sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
29982024-08-28T04:05:55.016ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9 saga_name = disk-delete
29992024-08-28T04:05:55.028ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9 saga_name = disk-delete
30002024-08-28T04:05:55.028ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9 saga_name = disk-delete sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30012024-08-28T04:05:55.028ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30022024-08-28T04:05:55.028ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30032024-08-28T04:05:55.032ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30042024-08-28T04:05:55.032ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30052024-08-28T04:05:55.035ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30062024-08-28T04:05:55.035ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30072024-08-28T04:05:55.046ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30082024-08-28T04:05:55.046ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("f4a23c2c-5cf4-474d-8350-852432b82d4d"), "name": String("disk-156ca3a8eae"), "time_created": String("2024-08-28T04:05:53.939959Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.939959Z")}, "pantry_address": Null, "project_id": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-08-28T04:05:54.877249Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}) node_id = 0 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30092024-08-28T04:05:55.049ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30102024-08-28T04:05:55.049ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30112024-08-28T04:05:55.052ZDEBGnexus (SagaExecutor): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true roles = RoleSet { roles: {} } saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9 saga_name = disk-delete saga_node = SpaceAccount
30122024-08-28T04:05:55.052ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true resource = Database result = Ok(()) saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9 saga_name = disk-delete saga_node = SpaceAccount
30132024-08-28T04:05:55.072ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30142024-08-28T04:05:55.072ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30152024-08-28T04:05:55.080ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30162024-08-28T04:05:55.080ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30172024-08-28T04:05:55.083ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30182024-08-28T04:05:55.083ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "silo_user_id": String("434f3819-8580-4baf-ad91-a501cc1bbc32")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}) node_id = 2 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30192024-08-28T04:05:55.086ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30202024-08-28T04:05:55.086ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30212024-08-28T04:05:55.090ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30222024-08-28T04:05:55.090ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30232024-08-28T04:05:55.093ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30242024-08-28T04:05:55.093ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30252024-08-28T04:05:55.132ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30262024-08-28T04:05:55.132ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array []}}) node_id = 4 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30272024-08-28T04:05:55.136ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30282024-08-28T04:05:55.136ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30292024-08-28T04:05:55.139ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30302024-08-28T04:05:55.139ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30312024-08-28T04:05:55.143ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30322024-08-28T04:05:55.143ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30332024-08-28T04:05:55.146ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30342024-08-28T04:05:55.146ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30352024-08-28T04:05:55.150ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30362024-08-28T04:05:55.150ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30372024-08-28T04:05:55.153ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30382024-08-28T04:05:55.153ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30392024-08-28T04:05:55.157ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30402024-08-28T04:05:55.157ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30412024-08-28T04:05:55.162ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30422024-08-28T04:05:55.162ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30432024-08-28T04:05:55.166ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30442024-08-28T04:05:55.166ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30452024-08-28T04:05:55.204ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 111.503699ms file = nexus/src/app/crucible.rs:827 region_id = 287208c2-b875-4424-a33b-4feae8ca3da9 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9 saga_name = disk-delete
30462024-08-28T04:05:55.321ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = 287208c2-b875-4424-a33b-4feae8ca3da9 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9 saga_name = disk-delete
30472024-08-28T04:05:55.376ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 102.321739ms file = nexus/src/app/crucible.rs:827 region_id = e7c7d85c-9fdf-4b83-b8e2-1c2fe6bcfd42 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9 saga_name = disk-delete
30482024-08-28T04:05:55.482ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = e7c7d85c-9fdf-4b83-b8e2-1c2fe6bcfd42 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9 saga_name = disk-delete
30492024-08-28T04:05:55.525ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 136.683915ms file = nexus/src/app/crucible.rs:827 region_id = 4fadbffa-b011-435b-8547-fc32166084cf saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9 saga_name = disk-delete
30502024-08-28T04:05:55.667ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = 4fadbffa-b011-435b-8547-fc32166084cf saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9 saga_name = disk-delete
30512024-08-28T04:05:55.687ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30522024-08-28T04:05:55.687ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30532024-08-28T04:05:55.691ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30542024-08-28T04:05:55.691ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30552024-08-28T04:05:55.699ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30562024-08-28T04:05:55.699ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30572024-08-28T04:05:55.703ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30582024-08-28T04:05:55.703ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30592024-08-28T04:05:55.706ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30602024-08-28T04:05:55.706ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30612024-08-28T04:05:55.709ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30622024-08-28T04:05:55.709ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30632024-08-28T04:05:55.713ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30642024-08-28T04:05:55.713ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30652024-08-28T04:05:55.715ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9 sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30662024-08-28T04:05:55.715ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9
30672024-08-28T04:05:55.722ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9 saga_name = disk-delete sec_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
30682024-08-28T04:05:55.722ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9 saga_name = disk-delete saga_result = SagaResult { saga_id: 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9, saga_log: SagaLog { saga_id: 6cc5820a-e80b-4ff4-8a7b-9520a8b201c9, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N006 started, N005 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("f4a23c2c-5cf4-474d-8350-852432b82d4d"), "name": String("disk-156ca3a8eae"), "time_created": String("2024-08-28T04:05:53.939959Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.939959Z")}, "pantry_address": Null, "project_id": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-08-28T04:05:54.877249Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "silo_user_id": String("434f3819-8580-4baf-ad91-a501cc1bbc32")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array []}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array []}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("f4a23c2c-5cf4-474d-8350-852432b82d4d"), "name": String("disk-156ca3a8eae"), "time_created": String("2024-08-28T04:05:53.939959Z"), "time_deleted": Null, "time_modified": String("2024-08-28T04:05:53.939959Z")}, "pantry_address": Null, "project_id": String("a16a488d-9cf3-46ab-854b-0c5f07eb0211"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-08-28T04:05:54.877249Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}, "final_no_result": Null, "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("e3abc6f9-763c-486e-9205-7ca93e3777ea"), "silo_user_id": String("434f3819-8580-4baf-ad91-a501cc1bbc32")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("9311a212-fa55-4773-99aa-3f47dfa7f07e")}, "volume_delete_subsaga_no_result": Null} }) }
30692024-08-28T04:05:55.723ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 771680 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 6d7cbe2c-3e3d-4e5e-a7ef-2ba7c01e06c1 response_code = 204 uri = /v1/disks/disk-156ca3a8eae?project=proj-e61e86e5477
30702024-08-28T04:05:55.724ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30712024-08-28T04:05:55.725ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30722024-08-28T04:05:55.726ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30732024-08-28T04:05:55.728ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = DeviceAuthRequestList result = Ok(())
30742024-08-28T04:05:55.728ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30752024-08-28T04:05:55.728ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30762024-08-28T04:05:55.732ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7807 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = 836d1106-6d7a-4a58-b460-3c1dcaa296a0 response_code = 200 uri = /device/auth
30772024-08-28T04:05:55.734ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30782024-08-28T04:05:55.734ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30792024-08-28T04:05:55.736ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30802024-08-28T04:05:55.736ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30812024-08-28T04:05:55.737ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30822024-08-28T04:05:55.738ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("token = \\"20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02\\"") } result = Ok(())
30832024-08-28T04:05:55.738ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30842024-08-28T04:05:55.739ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30852024-08-28T04:05:55.740ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30862024-08-28T04:05:55.740ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30872024-08-28T04:05:55.742ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30882024-08-28T04:05:55.742ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30892024-08-28T04:05:55.743ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30902024-08-28T04:05:55.743ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30912024-08-28T04:05:55.744ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30922024-08-28T04:05:55.746ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
30932024-08-28T04:05:55.746ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30942024-08-28T04:05:55.746ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30952024-08-28T04:05:55.747ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30962024-08-28T04:05:55.748ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02") } result = Ok(())
30972024-08-28T04:05:55.748ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30982024-08-28T04:05:55.748ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30992024-08-28T04:05:55.752ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31002024-08-28T04:05:55.752ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31012024-08-28T04:05:55.753ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31022024-08-28T04:05:55.753ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31032024-08-28T04:05:55.754ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31042024-08-28T04:05:55.755ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31052024-08-28T04:05:55.756ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31062024-08-28T04:05:55.756ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31072024-08-28T04:05:55.758ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31082024-08-28T04:05:55.759ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
31092024-08-28T04:05:55.759ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31102024-08-28T04:05:55.759ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31112024-08-28T04:05:55.760ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31122024-08-28T04:05:55.760ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31132024-08-28T04:05:55.762ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31142024-08-28T04:05:55.762ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31152024-08-28T04:05:55.763ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31162024-08-28T04:05:55.764ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) } result = Ok(())
31172024-08-28T04:05:55.764ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {} } uri = /device/confirm
31182024-08-28T04:05:55.764ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = Database result = Ok(()) uri = /device/confirm
31192024-08-28T04:05:55.772ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {} } uri = /device/confirm
31202024-08-28T04:05:55.772ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = Database result = Ok(()) uri = /device/confirm
31212024-08-28T04:05:55.775ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {} } uri = /device/confirm
31222024-08-28T04:05:55.775ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = Database result = Ok(()) uri = /device/confirm
31232024-08-28T04:05:55.777ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /device/confirm
31242024-08-28T04:05:55.778ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = DeviceAuthRequest { parent: Fleet, key: "CZRW-DMGX", lookup_type: ByCompositeId("user_code = \\"CZRW-DMGX\\"") } result = Ok(()) uri = /device/confirm
31252024-08-28T04:05:55.778ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {} } uri = /device/confirm
31262024-08-28T04:05:55.778ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = Database result = Ok(()) uri = /device/confirm
31272024-08-28T04:05:55.779ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {} } uri = /device/confirm
31282024-08-28T04:05:55.779ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = Database result = Ok(()) uri = /device/confirm
31292024-08-28T04:05:55.780ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {} } uri = /device/confirm
31302024-08-28T04:05:55.781ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = Database result = Ok(()) uri = /device/confirm
31312024-08-28T04:05:55.783ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {} } uri = /device/confirm
31322024-08-28T04:05:55.783ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = Database result = Ok(()) uri = /device/confirm
31332024-08-28T04:05:55.785ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {} } uri = /device/confirm
31342024-08-28T04:05:55.785ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = Database result = Ok(()) uri = /device/confirm
31352024-08-28T04:05:55.787ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /device/confirm
31362024-08-28T04:05:55.788ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(()) uri = /device/confirm
31372024-08-28T04:05:55.788ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {} } uri = /device/confirm
31382024-08-28T04:05:55.788ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = Database result = Ok(()) uri = /device/confirm
31392024-08-28T04:05:55.791ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {} } uri = /device/confirm
31402024-08-28T04:05:55.791ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = Database result = Ok(()) uri = /device/confirm
31412024-08-28T04:05:55.793ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /device/confirm
31422024-08-28T04:05:55.794ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = DeviceAuthRequest { parent: Fleet, key: "CZRW-DMGX", lookup_type: ByCompositeId("user_code = \\"CZRW-DMGX\\"") } result = Ok(()) uri = /device/confirm
31432024-08-28T04:05:55.794ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {} } uri = /device/confirm
31442024-08-28T04:05:55.794ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = Database result = Ok(()) uri = /device/confirm
31452024-08-28T04:05:55.796ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {} } uri = /device/confirm
31462024-08-28T04:05:55.796ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = Database result = Ok(()) uri = /device/confirm
31472024-08-28T04:05:55.798ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {} } uri = /device/confirm
31482024-08-28T04:05:55.798ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = Database result = Ok(()) uri = /device/confirm
31492024-08-28T04:05:55.801ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /device/confirm
31502024-08-28T04:05:55.802ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(()) uri = /device/confirm
31512024-08-28T04:05:55.802ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b roles = RoleSet { roles: {} } uri = /device/confirm
31522024-08-28T04:05:55.802ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b resource = Database result = Ok(()) uri = /device/confirm
31532024-08-28T04:05:55.831ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97387 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = a7f24ccf-b086-4761-a4f4-58c344df460b response_code = 204 uri = /device/confirm
31542024-08-28T04:05:55.833ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31552024-08-28T04:05:55.833ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31562024-08-28T04:05:55.848ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 15599 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:32887 req_id = e29e332a-0a4a-49fd-817c-f7d2cc751c6b response_code = 200 uri = /device/token
31572024-08-28T04:05:55.850ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31582024-08-28T04:05:55.850ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31592024-08-28T04:05:55.852ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31602024-08-28T04:05:55.852ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31612024-08-28T04:05:55.853ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31622024-08-28T04:05:55.855ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("token = \\"20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02\\"") } result = Ok(())
31632024-08-28T04:05:55.855ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31642024-08-28T04:05:55.855ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31652024-08-28T04:05:55.856ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31662024-08-28T04:05:55.856ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31672024-08-28T04:05:55.858ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31682024-08-28T04:05:55.858ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31692024-08-28T04:05:55.859ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31702024-08-28T04:05:55.859ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31712024-08-28T04:05:55.860ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31722024-08-28T04:05:55.862ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
31732024-08-28T04:05:55.862ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31742024-08-28T04:05:55.862ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31752024-08-28T04:05:55.863ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31762024-08-28T04:05:55.864ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02") } result = Ok(())
31772024-08-28T04:05:55.864ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31782024-08-28T04:05:55.864ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31792024-08-28T04:05:55.872ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31802024-08-28T04:05:55.872ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31812024-08-28T04:05:55.873ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31822024-08-28T04:05:55.874ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31832024-08-28T04:05:55.875ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31842024-08-28T04:05:55.875ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31852024-08-28T04:05:55.876ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31862024-08-28T04:05:55.876ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31872024-08-28T04:05:55.878ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31882024-08-28T04:05:55.879ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
31892024-08-28T04:05:55.879ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31902024-08-28T04:05:55.879ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31912024-08-28T04:05:55.887ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31922024-08-28T04:05:55.887ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31932024-08-28T04:05:55.889ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31942024-08-28T04:05:55.889ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31952024-08-28T04:05:55.890ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31962024-08-28T04:05:55.891ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) } result = Ok(())
31972024-08-28T04:05:55.891ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
31982024-08-28T04:05:55.891ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
31992024-08-28T04:05:55.893ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32002024-08-28T04:05:55.893ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32012024-08-28T04:05:55.895ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32022024-08-28T04:05:55.895ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32032024-08-28T04:05:55.898ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32042024-08-28T04:05:55.898ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32052024-08-28T04:05:55.900ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32062024-08-28T04:05:55.900ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32072024-08-28T04:05:55.902ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32082024-08-28T04:05:55.902ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32092024-08-28T04:05:55.904ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32102024-08-28T04:05:55.905ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32112024-08-28T04:05:55.907ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32122024-08-28T04:05:55.907ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32132024-08-28T04:05:55.912ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32142024-08-28T04:05:55.915ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ByName("proj-e61e86e5477") }, key: b1724e3f-3cff-478e-9b64-33e401bac27f, lookup_type: ByName("default") }, key: 63eb454c-b17c-4742-910e-a615e0fe2133, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32152024-08-28T04:05:55.915ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32162024-08-28T04:05:55.915ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32172024-08-28T04:05:55.918ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32182024-08-28T04:05:55.918ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32192024-08-28T04:05:55.920ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32202024-08-28T04:05:55.920ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32212024-08-28T04:05:55.922ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32222024-08-28T04:05:55.922ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32232024-08-28T04:05:55.924ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32242024-08-28T04:05:55.927ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ByName("proj-e61e86e5477") }, key: b1724e3f-3cff-478e-9b64-33e401bac27f, lookup_type: ByName("default") }, key: 63eb454c-b17c-4742-910e-a615e0fe2133, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32252024-08-28T04:05:55.927ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32262024-08-28T04:05:55.927ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32272024-08-28T04:05:55.930ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32282024-08-28T04:05:55.930ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32292024-08-28T04:05:55.934ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32302024-08-28T04:05:55.935ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32312024-08-28T04:05:55.943ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32322024-08-28T04:05:55.943ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32332024-08-28T04:05:55.947ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97150 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 42329aee-a5f3-45b2-9ae8-c3f297d3387e response_code = 204 uri = /v1/vpc-subnets/default?project=proj-e61e86e5477&vpc=default
32342024-08-28T04:05:55.947ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Signaled
32352024-08-28T04:05:55.947ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32362024-08-28T04:05:55.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32372024-08-28T04:05:55.949ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32382024-08-28T04:05:55.949ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32392024-08-28T04:05:55.949ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32402024-08-28T04:05:55.950ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32412024-08-28T04:05:55.951ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32422024-08-28T04:05:55.951ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32432024-08-28T04:05:55.951ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32442024-08-28T04:05:55.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32452024-08-28T04:05:55.952ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32462024-08-28T04:05:55.952ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32472024-08-28T04:05:55.953ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("token = \\"20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02\\"") } result = Ok(())
32482024-08-28T04:05:55.953ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32492024-08-28T04:05:55.954ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32502024-08-28T04:05:55.954ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32512024-08-28T04:05:55.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32522024-08-28T04:05:55.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32532024-08-28T04:05:55.955ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32542024-08-28T04:05:55.955ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32552024-08-28T04:05:55.956ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32562024-08-28T04:05:55.957ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32572024-08-28T04:05:55.958ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32582024-08-28T04:05:55.958ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32592024-08-28T04:05:55.959ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32602024-08-28T04:05:55.960ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
32612024-08-28T04:05:55.960ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32622024-08-28T04:05:55.960ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32632024-08-28T04:05:55.962ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32642024-08-28T04:05:55.963ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02") } result = Ok(())
32652024-08-28T04:05:55.963ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32662024-08-28T04:05:55.963ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32672024-08-28T04:05:55.987ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32682024-08-28T04:05:55.989ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0271b611-e920-4e4b-a700-e965b211f31e", "content-length": "312", "date": "Wed, 28 Aug 2024 04:05:55 GMT"} })
32692024-08-28T04:05:55.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32702024-08-28T04:05:55.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32712024-08-28T04:05:55.991ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32722024-08-28T04:05:55.991ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32732024-08-28T04:05:55.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32742024-08-28T04:05:55.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32752024-08-28T04:05:55.992ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32762024-08-28T04:05:55.992ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32772024-08-28T04:05:55.993ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32782024-08-28T04:05:55.994ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32792024-08-28T04:05:55.994ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32802024-08-28T04:05:55.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32812024-08-28T04:05:55.995ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32822024-08-28T04:05:55.995ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32832024-08-28T04:05:55.996ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32842024-08-28T04:05:55.997ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32852024-08-28T04:05:55.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32862024-08-28T04:05:55.998ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
32872024-08-28T04:05:55.998ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32882024-08-28T04:05:55.998ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32892024-08-28T04:05:55.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32902024-08-28T04:05:55.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32912024-08-28T04:05:55.999ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32922024-08-28T04:05:55.999ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32932024-08-28T04:05:56.000ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32942024-08-28T04:05:56.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32952024-08-28T04:05:56.001ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32962024-08-28T04:05:56.001ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32972024-08-28T04:05:56.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32982024-08-28T04:05:56.002ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32992024-08-28T04:05:56.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33002024-08-28T04:05:56.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33012024-08-28T04:05:56.003ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) } result = Ok(())
33022024-08-28T04:05:56.003ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33032024-08-28T04:05:56.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33042024-08-28T04:05:56.003ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33052024-08-28T04:05:56.004ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33062024-08-28T04:05:56.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33072024-08-28T04:05:56.005ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33082024-08-28T04:05:56.005ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33092024-08-28T04:05:56.006ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33102024-08-28T04:05:56.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33112024-08-28T04:05:56.006ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33122024-08-28T04:05:56.006ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33132024-08-28T04:05:56.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33142024-08-28T04:05:56.008ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33152024-08-28T04:05:56.008ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33162024-08-28T04:05:56.010ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33172024-08-28T04:05:56.010ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33182024-08-28T04:05:56.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
33192024-08-28T04:05:56.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33202024-08-28T04:05:56.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33212024-08-28T04:05:56.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33222024-08-28T04:05:56.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33232024-08-28T04:05:56.012ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33242024-08-28T04:05:56.012ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33252024-08-28T04:05:56.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33262024-08-28T04:05:56.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33272024-08-28T04:05:56.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33282024-08-28T04:05:56.015ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33292024-08-28T04:05:56.015ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33302024-08-28T04:05:56.017ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33312024-08-28T04:05:56.017ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
33322024-08-28T04:05:56.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33332024-08-28T04:05:56.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33342024-08-28T04:05:56.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33352024-08-28T04:05:56.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33362024-08-28T04:05:56.020ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ByName("proj-e61e86e5477") }, key: b1724e3f-3cff-478e-9b64-33e401bac27f, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33372024-08-28T04:05:56.020ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33382024-08-28T04:05:56.020ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33392024-08-28T04:05:56.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33402024-08-28T04:05:56.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33412024-08-28T04:05:56.022ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33422024-08-28T04:05:56.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33432024-08-28T04:05:56.023ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33442024-08-28T04:05:56.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33452024-08-28T04:05:56.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33462024-08-28T04:05:56.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33472024-08-28T04:05:56.025ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33482024-08-28T04:05:56.025ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33492024-08-28T04:05:56.025ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33502024-08-28T04:05:56.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33512024-08-28T04:05:56.027ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33522024-08-28T04:05:56.027ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33532024-08-28T04:05:56.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33542024-08-28T04:05:56.027ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33552024-08-28T04:05:56.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33562024-08-28T04:05:56.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33572024-08-28T04:05:56.029ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33582024-08-28T04:05:56.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33592024-08-28T04:05:56.031ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ByName("proj-e61e86e5477") }, key: b1724e3f-3cff-478e-9b64-33e401bac27f, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33602024-08-28T04:05:56.031ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33612024-08-28T04:05:56.031ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33622024-08-28T04:05:56.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
33632024-08-28T04:05:56.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33642024-08-28T04:05:56.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33652024-08-28T04:05:56.033ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33662024-08-28T04:05:56.033ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33672024-08-28T04:05:56.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33682024-08-28T04:05:56.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33692024-08-28T04:05:56.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33702024-08-28T04:05:56.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33712024-08-28T04:05:56.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33722024-08-28T04:05:56.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33732024-08-28T04:05:56.037ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33742024-08-28T04:05:56.038ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33752024-08-28T04:05:56.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33762024-08-28T04:05:56.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33772024-08-28T04:05:56.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33782024-08-28T04:05:56.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33792024-08-28T04:05:56.040ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33802024-08-28T04:05:56.040ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33812024-08-28T04:05:56.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33822024-08-28T04:05:56.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33832024-08-28T04:05:56.042ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33842024-08-28T04:05:56.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33852024-08-28T04:05:56.042ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33862024-08-28T04:05:56.044ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33872024-08-28T04:05:56.045ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33882024-08-28T04:05:56.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ByName("boundary-ntp") } result = Ok(())
33892024-08-28T04:05:56.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33902024-08-28T04:05:56.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33912024-08-28T04:05:56.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33922024-08-28T04:05:56.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33932024-08-28T04:05:56.047ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33942024-08-28T04:05:56.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33952024-08-28T04:05:56.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33962024-08-28T04:05:56.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33972024-08-28T04:05:56.050ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ByName("proj-e61e86e5477") }, key: b1724e3f-3cff-478e-9b64-33e401bac27f, lookup_type: ByName("default") }, key: b1978a0b-0f2b-434b-bb59-99f4bffc2117, lookup_type: ById(b1978a0b-0f2b-434b-bb59-99f4bffc2117) } result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
33982024-08-28T04:05:56.050ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
33992024-08-28T04:05:56.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34002024-08-28T04:05:56.050ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
34012024-08-28T04:05:56.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34022024-08-28T04:05:56.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34032024-08-28T04:05:56.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34042024-08-28T04:05:56.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34052024-08-28T04:05:56.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34062024-08-28T04:05:56.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34072024-08-28T04:05:56.054ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
34082024-08-28T04:05:56.055ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
34092024-08-28T04:05:56.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34102024-08-28T04:05:56.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
34112024-08-28T04:05:56.058ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34122024-08-28T04:05:56.059ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
34132024-08-28T04:05:56.059ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
34142024-08-28T04:05:56.060ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6b40fc0d-db99-4002-957c-0cd965a65540", "date": "Wed, 28 Aug 2024 04:05:55 GMT"} })
34152024-08-28T04:05:56.061ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
34162024-08-28T04:05:56.061ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
34172024-08-28T04:05:56.062ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 114.368919ms iteration = 2 status = {}
34182024-08-28T04:05:56.063ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
34192024-08-28T04:05:56.063ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
34202024-08-28T04:05:56.065ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
34212024-08-28T04:05:56.065ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
34222024-08-28T04:05:56.068ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
34232024-08-28T04:05:56.068ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
34242024-08-28T04:05:56.070ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/vpcs/default?project=proj-e61e86e5477
34252024-08-28T04:05:56.073ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ByName("proj-e61e86e5477") }, key: b1724e3f-3cff-478e-9b64-33e401bac27f, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
34262024-08-28T04:05:56.073ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-e61e86e5477
34272024-08-28T04:05:56.073ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-e61e86e5477
34282024-08-28T04:05:56.078ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 129755 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 1331f7e5-dc9e-46e7-8120-ba4da19bcc08 response_code = 204 uri = /v1/vpcs/default?project=proj-e61e86e5477
34292024-08-28T04:05:56.080ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34302024-08-28T04:05:56.080ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34312024-08-28T04:05:56.081ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34322024-08-28T04:05:56.081ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34332024-08-28T04:05:56.082ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34342024-08-28T04:05:56.083ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("token = \\"20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02\\"") } result = Ok(())
34352024-08-28T04:05:56.083ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34362024-08-28T04:05:56.083ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34372024-08-28T04:05:56.085ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34382024-08-28T04:05:56.085ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34392024-08-28T04:05:56.086ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34402024-08-28T04:05:56.086ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34412024-08-28T04:05:56.088ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34422024-08-28T04:05:56.088ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34432024-08-28T04:05:56.089ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34442024-08-28T04:05:56.090ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
34452024-08-28T04:05:56.090ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34462024-08-28T04:05:56.090ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34472024-08-28T04:05:56.092ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34482024-08-28T04:05:56.093ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02", lookup_type: ByCompositeId("20f87cbbf5c1d0ddbb2d2d55625de8b8c3f66e02") } result = Ok(())
34492024-08-28T04:05:56.093ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34502024-08-28T04:05:56.093ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34512024-08-28T04:05:56.097ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34522024-08-28T04:05:56.097ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34532024-08-28T04:05:56.098ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34542024-08-28T04:05:56.098ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34552024-08-28T04:05:56.099ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34562024-08-28T04:05:56.100ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34572024-08-28T04:05:56.101ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34582024-08-28T04:05:56.101ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34592024-08-28T04:05:56.102ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34602024-08-28T04:05:56.103ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: 434f3819-8580-4baf-ad91-a501cc1bbc32, lookup_type: ById(434f3819-8580-4baf-ad91-a501cc1bbc32) } result = Ok(())
34612024-08-28T04:05:56.103ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34622024-08-28T04:05:56.103ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34632024-08-28T04:05:56.104ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34642024-08-28T04:05:56.104ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34652024-08-28T04:05:56.106ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34662024-08-28T04:05:56.106ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34672024-08-28T04:05:56.107ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34682024-08-28T04:05:56.108ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) } result = Ok(())
34692024-08-28T04:05:56.108ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
34702024-08-28T04:05:56.108ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
34712024-08-28T04:05:56.109ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
34722024-08-28T04:05:56.109ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
34732024-08-28T04:05:56.111ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
34742024-08-28T04:05:56.111ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
34752024-08-28T04:05:56.113ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
34762024-08-28T04:05:56.113ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
34772024-08-28T04:05:56.116ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
34782024-08-28T04:05:56.116ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
34792024-08-28T04:05:56.118ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
34802024-08-28T04:05:56.118ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
34812024-08-28T04:05:56.120ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/projects/proj-e61e86e5477
34822024-08-28T04:05:56.121ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ByName("proj-e61e86e5477") } result = Ok(()) uri = /v1/projects/proj-e61e86e5477
34832024-08-28T04:05:56.121ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
34842024-08-28T04:05:56.122ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
34852024-08-28T04:05:56.124ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
34862024-08-28T04:05:56.124ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
34872024-08-28T04:05:56.126ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
34882024-08-28T04:05:56.127ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
34892024-08-28T04:05:56.129ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
34902024-08-28T04:05:56.129ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
34912024-08-28T04:05:56.131ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {(Silo, e3abc6f9-763c-486e-9205-7ca93e3777ea, "admin")} } uri = /v1/projects/proj-e61e86e5477
34922024-08-28T04:05:56.133ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Project { parent: Silo { parent: Fleet, key: e3abc6f9-763c-486e-9205-7ca93e3777ea, lookup_type: ById(e3abc6f9-763c-486e-9205-7ca93e3777ea) }, key: a16a488d-9cf3-46ab-854b-0c5f07eb0211, lookup_type: ByName("proj-e61e86e5477") } result = Ok(()) uri = /v1/projects/proj-e61e86e5477
34932024-08-28T04:05:56.133ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
34942024-08-28T04:05:56.133ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
34952024-08-28T04:05:56.135ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
34962024-08-28T04:05:56.135ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
34972024-08-28T04:05:56.145ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
34982024-08-28T04:05:56.145ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
34992024-08-28T04:05:56.156ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
35002024-08-28T04:05:56.156ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
35012024-08-28T04:05:56.172ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
35022024-08-28T04:05:56.172ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
35032024-08-28T04:05:56.183ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
35042024-08-28T04:05:56.183ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
35052024-08-28T04:05:56.184ZDEBGnexus (dropshot_external): roles actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 roles = RoleSet { roles: {} } uri = /v1/projects/proj-e61e86e5477
35062024-08-28T04:05:56.184ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 434f3819-8580-4baf-ad91-a501cc1bbc32, silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, .. }) actor_id = 434f3819-8580-4baf-ad91-a501cc1bbc32 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 resource = Database result = Ok(()) uri = /v1/projects/proj-e61e86e5477
35072024-08-28T04:05:56.193ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 113941 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:32887 req_id = 84873ff4-dee7-4cc7-865f-69d7b2a6ed07 response_code = 204 uri = /v1/projects/proj-e61e86e5477
35082024-08-28T04:05:57.062ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
35092024-08-28T04:05:57.062ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
35102024-08-28T04:05:57.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35112024-08-28T04:05:57.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35122024-08-28T04:05:57.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35132024-08-28T04:05:57.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35142024-08-28T04:05:57.065ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35152024-08-28T04:05:57.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35162024-08-28T04:05:57.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35172024-08-28T04:05:57.068ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.316565ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35182024-08-28T04:05:57.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35192024-08-28T04:05:57.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35202024-08-28T04:05:57.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35212024-08-28T04:05:57.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35222024-08-28T04:05:57.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35232024-08-28T04:05:57.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35242024-08-28T04:05:57.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
35252024-08-28T04:05:57.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35262024-08-28T04:05:57.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35272024-08-28T04:05:57.086ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
35282024-08-28T04:05:57.086ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.335285ms iteration = 3 status = {"enabled":false,"status":"first target blueprint","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z","time_found":"2024-08-28T04:05:57.086048167Z"}
35292024-08-28T04:05:57.086ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
35302024-08-28T04:05:57.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
35312024-08-28T04:05:57.086ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764
35322024-08-28T04:05:57.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35332024-08-28T04:05:57.086ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.17\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764"}
35342024-08-28T04:05:57.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35352024-08-28T04:05:57.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35362024-08-28T04:05:57.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35372024-08-28T04:05:57.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35382024-08-28T04:05:57.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35392024-08-28T04:05:57.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35402024-08-28T04:05:57.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35412024-08-28T04:05:57.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35422024-08-28T04:05:57.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35432024-08-28T04:05:57.088ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35442024-08-28T04:05:57.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35452024-08-28T04:05:57.090ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35462024-08-28T04:05:57.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35472024-08-28T04:05:57.090ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35482024-08-28T04:05:57.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35492024-08-28T04:05:57.092ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35502024-08-28T04:05:57.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35512024-08-28T04:05:57.092ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35522024-08-28T04:05:57.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35532024-08-28T04:05:57.094ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35542024-08-28T04:05:57.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35552024-08-28T04:05:57.094ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35562024-08-28T04:05:57.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35572024-08-28T04:05:57.096ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35582024-08-28T04:05:57.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35592024-08-28T04:05:57.096ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35602024-08-28T04:05:57.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35612024-08-28T04:05:57.098ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35622024-08-28T04:05:57.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35632024-08-28T04:05:57.130ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
35642024-08-28T04:05:57.162ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
35652024-08-28T04:05:57.194ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
35662024-08-28T04:05:57.226ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
35672024-08-28T04:05:57.257ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
35682024-08-28T04:05:57.526ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::5)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "269cb4bf-a791-426a-8aef-5fb4c8eff0ee", "content-length": "64", "date": "Wed, 28 Aug 2024 04:05:57 GMT"} })
35692024-08-28T04:05:57.526ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35702024-08-28T04:05:57.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35712024-08-28T04:05:57.529ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35722024-08-28T04:05:57.530ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35732024-08-28T04:05:57.530ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35742024-08-28T04:05:57.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35752024-08-28T04:05:57.562ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::7)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0cb3a13f-72ec-4074-9b0b-cb7320d63ac7", "content-length": "64", "date": "Wed, 28 Aug 2024 04:05:56 GMT"} })
35762024-08-28T04:05:57.563ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35772024-08-28T04:05:57.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35782024-08-28T04:05:57.564ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35792024-08-28T04:05:57.566ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35802024-08-28T04:05:57.566ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35812024-08-28T04:05:57.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35822024-08-28T04:05:57.576ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::4)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b2527906-e49b-4382-bb6a-703340c74e36", "content-length": "64", "date": "Wed, 28 Aug 2024 04:05:57 GMT"} })
35832024-08-28T04:05:57.576ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35842024-08-28T04:05:57.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35852024-08-28T04:05:57.578ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35862024-08-28T04:05:57.579ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35872024-08-28T04:05:57.579ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35882024-08-28T04:05:57.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35892024-08-28T04:05:57.656ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::6)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c4c56661-c802-4874-ad19-41d35f20c88c", "content-length": "64", "date": "Wed, 28 Aug 2024 04:05:57 GMT"} })
35902024-08-28T04:05:57.656ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35912024-08-28T04:05:57.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35922024-08-28T04:05:57.658ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35932024-08-28T04:05:57.660ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35942024-08-28T04:05:57.660ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35952024-08-28T04:05:57.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35962024-08-28T04:05:57.715ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::3)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b220632f-c70f-4211-8543-e40dee35f634", "content-length": "64", "date": "Wed, 28 Aug 2024 04:05:57 GMT"} })
35972024-08-28T04:05:57.715ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35982024-08-28T04:05:57.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35992024-08-28T04:05:57.717ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36002024-08-28T04:05:57.718ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
36012024-08-28T04:05:57.718ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36022024-08-28T04:05:57.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36032024-08-28T04:05:57.729ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 643.635875ms iteration = 2 status = {"nsuccess":5}
36042024-08-28T04:06:01.109ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:53641 remote_addr = [fd00:1122:3344:101::d]:33112
36052024-08-28T04:06:01.110ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1547 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 42b7bb3c-e890-4913-93c6-d9e10544e205 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
36062024-08-28T04:06:07.062ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
36072024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
36082024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36092024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36102024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36112024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
36122024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36132024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
36142024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
36152024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36162024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
36172024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36182024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
36192024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
36202024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
36212024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36222024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36232024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36242024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
36252024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36262024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
36272024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
36282024-08-28T04:06:07.063ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
36292024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36302024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36312024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
36322024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36332024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
36342024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36352024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
36362024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
36372024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36382024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36392024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36402024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36412024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36422024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36432024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36442024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36452024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36462024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36472024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36482024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36492024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36502024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36512024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36522024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
36532024-08-28T04:06:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36542024-08-28T04:06:07.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36552024-08-28T04:06:07.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36562024-08-28T04:06:07.070ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36572024-08-28T04:06:07.071ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.451058ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36582024-08-28T04:06:07.072ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1054, tv_nsec: 153382038 } })
36592024-08-28T04:06:07.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36602024-08-28T04:06:07.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36612024-08-28T04:06:07.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36622024-08-28T04:06:07.073ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
36632024-08-28T04:06:07.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36642024-08-28T04:06:07.074ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36652024-08-28T04:06:07.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36662024-08-28T04:06:07.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36672024-08-28T04:06:07.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36682024-08-28T04:06:07.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36692024-08-28T04:06:07.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36702024-08-28T04:06:07.075ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36712024-08-28T04:06:07.075ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36722024-08-28T04:06:07.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36732024-08-28T04:06:07.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36742024-08-28T04:06:07.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36752024-08-28T04:06:07.078ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36762024-08-28T04:06:07.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36772024-08-28T04:06:07.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36782024-08-28T04:06:07.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36792024-08-28T04:06:07.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36802024-08-28T04:06:07.079ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1054, tv_nsec: 161245439 } })
36812024-08-28T04:06:07.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36822024-08-28T04:06:07.079ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36832024-08-28T04:06:07.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36842024-08-28T04:06:07.080ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
36852024-08-28T04:06:07.081ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36862024-08-28T04:06:07.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36872024-08-28T04:06:07.082ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36882024-08-28T04:06:07.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36892024-08-28T04:06:07.082ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36902024-08-28T04:06:07.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36912024-08-28T04:06:07.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36922024-08-28T04:06:07.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36932024-08-28T04:06:07.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36942024-08-28T04:06:07.085ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1054, tv_nsec: 166370390 } })
36952024-08-28T04:06:07.085ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
36962024-08-28T04:06:07.086ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36972024-08-28T04:06:07.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36982024-08-28T04:06:07.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36992024-08-28T04:06:07.092ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37002024-08-28T04:06:07.092ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 29.710002ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37012024-08-28T04:06:07.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37022024-08-28T04:06:07.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37032024-08-28T04:06:07.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37042024-08-28T04:06:07.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
37052024-08-28T04:06:07.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37062024-08-28T04:06:07.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37072024-08-28T04:06:07.111ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
37082024-08-28T04:06:07.111ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37092024-08-28T04:06:07.111ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37102024-08-28T04:06:07.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37112024-08-28T04:06:07.116ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37122024-08-28T04:06:07.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37132024-08-28T04:06:07.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.86487ms iteration = 2 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
37142024-08-28T04:06:07.121ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37152024-08-28T04:06:07.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37162024-08-28T04:06:07.121ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
37172024-08-28T04:06:07.121ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.940801ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
37182024-08-28T04:06:07.122ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37192024-08-28T04:06:07.122ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.704553ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37202024-08-28T04:06:07.124ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37212024-08-28T04:06:07.124ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37222024-08-28T04:06:07.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37232024-08-28T04:06:07.126ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37242024-08-28T04:06:07.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37252024-08-28T04:06:07.126ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37262024-08-28T04:06:07.127ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.049561ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
37272024-08-28T04:06:07.128ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37282024-08-28T04:06:07.128ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37292024-08-28T04:06:07.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37302024-08-28T04:06:07.132ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37312024-08-28T04:06:07.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37322024-08-28T04:06:07.134ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37332024-08-28T04:06:07.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37342024-08-28T04:06:07.134ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 71.594772ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
37352024-08-28T04:06:07.155ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
37362024-08-28T04:06:07.155ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37372024-08-28T04:06:07.155ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 92.557189ms iteration = 2 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
37382024-08-28T04:06:07.155ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37392024-08-28T04:06:07.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37402024-08-28T04:06:07.165ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
37412024-08-28T04:06:07.165ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37422024-08-28T04:06:07.165ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b37facba-e5d0-4db7-a3c3-42b613d31d41", "content-length": "26", "date": "Wed, 28 Aug 2024 04:06:06 GMT"} })
37432024-08-28T04:06:07.165ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37442024-08-28T04:06:07.167ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37452024-08-28T04:06:07.177ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 114.667658ms iteration = 4 status = {"physical_disks_added":0}
37462024-08-28T04:06:07.182ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
37472024-08-28T04:06:07.182ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37482024-08-28T04:06:07.182ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9dc8492a-878e-41f8-b2a3-7a42b3f72810", "content-length": "26", "date": "Wed, 28 Aug 2024 04:06:06 GMT"} })
37492024-08-28T04:06:07.182ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37502024-08-28T04:06:07.182ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37512024-08-28T04:06:07.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37522024-08-28T04:06:07.183ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37532024-08-28T04:06:07.257ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 zone_address = fd00:1122:3344:101::2
37542024-08-28T04:06:07.257ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37552024-08-28T04:06:07.258ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "42861940-92d5-4522-83d7-0a6832f0ed2a", "content-length": "26", "date": "Wed, 28 Aug 2024 04:06:06 GMT"} })
37562024-08-28T04:06:07.258ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37572024-08-28T04:06:07.259ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
37582024-08-28T04:06:07.345ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37592024-08-28T04:06:07.346ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5f8cad8d-a52f-4f46-a32b-bda716be32c9", "content-length": "691", "date": "Wed, 28 Aug 2024 04:06:06 GMT"} })
37602024-08-28T04:06:07.346ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
37612024-08-28T04:06:07.346ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
37622024-08-28T04:06:07.346ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
37632024-08-28T04:06:07.347ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 284.458926ms iteration = 2 status = {}
37642024-08-28T04:06:07.348ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37652024-08-28T04:06:07.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37662024-08-28T04:06:07.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37672024-08-28T04:06:07.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
37682024-08-28T04:06:07.353ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37692024-08-28T04:06:07.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37702024-08-28T04:06:07.354ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 291.726899ms iteration = 2 status = 0
37712024-08-28T04:06:07.379ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
37722024-08-28T04:06:07.379ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 316.519347ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
37732024-08-28T04:06:07.408ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37742024-08-28T04:06:07.408ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "66f293be-8e4b-43b0-a86e-726aad50f666", "content-length": "1", "date": "Wed, 28 Aug 2024 04:06:06 GMT"} })
37752024-08-28T04:06:07.410ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37762024-08-28T04:06:07.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37772024-08-28T04:06:07.412ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 349.454655ms iteration = 2 status = null
37782024-08-28T04:06:07.438ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 375.724167ms iteration = 2 status = {}
37792024-08-28T04:06:07.438ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37802024-08-28T04:06:07.499ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6359b832-a5b0-46dd-9b93-f27827c69890", "content-length": "372", "date": "Wed, 28 Aug 2024 04:06:06 GMT"} })
37812024-08-28T04:06:07.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37822024-08-28T04:06:07.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37832024-08-28T04:06:07.502ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37842024-08-28T04:06:07.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37852024-08-28T04:06:07.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37862024-08-28T04:06:07.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37872024-08-28T04:06:07.508ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37882024-08-28T04:06:07.508ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "68d4126b-809c-470c-af45-e65456956429", "date": "Wed, 28 Aug 2024 04:06:07 GMT"} })
37892024-08-28T04:06:07.509ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37902024-08-28T04:06:07.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37912024-08-28T04:06:07.509ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 446.830055ms iteration = 3 status = {}
37922024-08-28T04:06:07.519ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 21872882-9c7e-4a12-8d80-3d3b1686a012, rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(726f0c10-a692-46cf-962b-4ac9a2a107fc) } rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
37932024-08-28T04:06:07.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37942024-08-28T04:06:07.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37952024-08-28T04:06:07.530ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37962024-08-28T04:06:07.531ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b21fd492-e107-46e3-8089-ec94f01be0b3", "content-length": "121", "date": "Wed, 28 Aug 2024 04:06:06 GMT"} })
37972024-08-28T04:06:07.531ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
37982024-08-28T04:06:07.531ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 726f0c10-a692-46cf-962b-4ac9a2a107fc
37992024-08-28T04:06:07.531ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38002024-08-28T04:06:07.531ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38012024-08-28T04:06:07.531ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
38022024-08-28T04:06:07.531ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
38032024-08-28T04:06:07.531ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
38042024-08-28T04:06:07.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38052024-08-28T04:06:07.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38062024-08-28T04:06:07.551ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38072024-08-28T04:06:07.551ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ecd33e16-b684-456e-b65b-95207d014fc8", "content-length": "2", "date": "Wed, 28 Aug 2024 04:06:06 GMT"} })
38082024-08-28T04:06:07.551ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38092024-08-28T04:06:07.551ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0b4bb072-a909-41a3-8d98-b393e5ffd8dc", "content-length": "50", "date": "Wed, 28 Aug 2024 04:06:06 GMT"} })
38102024-08-28T04:06:07.551ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
38112024-08-28T04:06:07.551ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38122024-08-28T04:06:07.645ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "39733880-125f-4af1-9b56-dd89e085d709", "date": "Wed, 28 Aug 2024 04:06:07 GMT"} })
38132024-08-28T04:06:07.645ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch = Switch0
38142024-08-28T04:06:07.645ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38152024-08-28T04:06:07.645ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "235169ce-da69-44f2-a2d7-5a9edf599589", "content-length": "667", "date": "Wed, 28 Aug 2024 04:06:07 GMT"} })
38162024-08-28T04:06:07.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38172024-08-28T04:06:07.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38182024-08-28T04:06:07.657ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38192024-08-28T04:06:07.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38202024-08-28T04:06:07.660ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38212024-08-28T04:06:07.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38222024-08-28T04:06:07.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38232024-08-28T04:06:07.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38242024-08-28T04:06:07.679ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 616.725695ms iteration = 2 status = {}
38252024-08-28T04:06:11.110ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1583 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 62ac0ea4-8de0-48fb-af66-bfd56235edb0 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
38262024-08-28T04:06:17.062ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
38272024-08-28T04:06:17.062ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
38282024-08-28T04:06:17.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38292024-08-28T04:06:17.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38302024-08-28T04:06:17.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38312024-08-28T04:06:17.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38322024-08-28T04:06:17.065ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38332024-08-28T04:06:17.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38342024-08-28T04:06:17.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38352024-08-28T04:06:17.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38362024-08-28T04:06:17.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38372024-08-28T04:06:17.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38382024-08-28T04:06:17.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.299291ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38392024-08-28T04:06:17.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38402024-08-28T04:06:17.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38412024-08-28T04:06:17.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38422024-08-28T04:06:17.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
38432024-08-28T04:06:17.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38442024-08-28T04:06:17.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38452024-08-28T04:06:17.131ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
38462024-08-28T04:06:17.131ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.491062ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
38472024-08-28T04:06:21.110ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = bb21fbc7-ca13-4f0a-b931-45284a203b13 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
38482024-08-28T04:06:22.203ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:59692
38492024-08-28T04:06:22.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59692 req_id = e1cbd624-2dae-45ef-8931-84d673f1266c roles = RoleSet { roles: {} } uri = /metrics/producers
38502024-08-28T04:06:22.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59692 req_id = e1cbd624-2dae-45ef-8931-84d673f1266c resource = Database result = Ok(()) uri = /metrics/producers
38512024-08-28T04:06:22.238ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
38522024-08-28T04:06:22.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59692 req_id = e1cbd624-2dae-45ef-8931-84d673f1266c roles = RoleSet { roles: {} } uri = /metrics/producers
38532024-08-28T04:06:22.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59692 req_id = e1cbd624-2dae-45ef-8931-84d673f1266c resource = Database result = Ok(()) uri = /metrics/producers
38542024-08-28T04:06:22.272ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
38552024-08-28T04:06:22.273ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "093aa7ff-9e6f-46b7-a353-8fd7855cf35c", "date": "Wed, 28 Aug 2024 04:06:22 GMT"} })
38562024-08-28T04:06:22.273ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 3cb8c6a9-56d6-4181-bb25-feecc98b4c4e
38572024-08-28T04:06:22.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 71124 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59692 req_id = e1cbd624-2dae-45ef-8931-84d673f1266c response_code = 201 uri = /metrics/producers
38582024-08-28T04:06:27.062ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
38592024-08-28T04:06:27.063ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
38602024-08-28T04:06:27.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38612024-08-28T04:06:27.063ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38622024-08-28T04:06:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38632024-08-28T04:06:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38642024-08-28T04:06:27.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38652024-08-28T04:06:27.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38662024-08-28T04:06:27.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38672024-08-28T04:06:27.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38682024-08-28T04:06:27.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38692024-08-28T04:06:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38702024-08-28T04:06:27.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38712024-08-28T04:06:27.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
38722024-08-28T04:06:27.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38732024-08-28T04:06:27.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38742024-08-28T04:06:27.082ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
38752024-08-28T04:06:27.083ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.092151ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
38762024-08-28T04:06:27.097ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38772024-08-28T04:06:27.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38782024-08-28T04:06:27.123ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.58188ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38792024-08-28T04:06:31.109ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1555 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 502029f3-c669-48b7-9b41-6c75aa3b7718 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
38802024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
38812024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
38822024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38832024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38842024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
38852024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
38862024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38872024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38882024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
38892024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
38902024-08-28T04:06:37.062ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 03:56:37.062572876 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
38912024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
38922024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38932024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
38942024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
38952024-08-28T04:06:37.062ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
38962024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
38972024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38982024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38992024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
39002024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39012024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
39022024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39032024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
39042024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39052024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39062024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
39072024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39082024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
39092024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39102024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
39112024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
39122024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39132024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39142024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
39152024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39162024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
39172024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39182024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
39192024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39202024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
39212024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
39222024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39232024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
39242024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
39252024-08-28T04:06:37.062ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764
39262024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
39272024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.071\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764"}
39282024-08-28T04:06:37.062ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
39292024-08-28T04:06:37.063ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
39302024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39312024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39322024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39332024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
39342024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
39352024-08-28T04:06:37.063ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
39362024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Timeout
39372024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Timeout
39382024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39392024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
39402024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
39412024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39422024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39432024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39442024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39452024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39462024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39472024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39482024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39492024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39502024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39512024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39522024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39532024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39542024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39552024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
39562024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39572024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39582024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
39592024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
39602024-08-28T04:06:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39612024-08-28T04:06:37.064ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("037b07ce-9e39-4982-8c20-c4c38f448b97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4e2ba65e-422a-4b1e-b0e3-85f8149a979a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 146383833 } })
39622024-08-28T04:06:37.065ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4eb364e4-14a2-46c4-b173-eb2890920e8f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 146596889 } })
39632024-08-28T04:06:37.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39642024-08-28T04:06:37.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39652024-08-28T04:06:37.071ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
39662024-08-28T04:06:37.071ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 7.900232ms iteration = 3 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
39672024-08-28T04:06:37.071ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.667385ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39682024-08-28T04:06:37.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39692024-08-28T04:06:37.072ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39702024-08-28T04:06:37.072ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
39712024-08-28T04:06:37.072ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 9.246172ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
39722024-08-28T04:06:37.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39732024-08-28T04:06:37.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39742024-08-28T04:06:37.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39752024-08-28T04:06:37.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39762024-08-28T04:06:37.074ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39772024-08-28T04:06:37.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39782024-08-28T04:06:37.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39792024-08-28T04:06:37.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.966011ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
39802024-08-28T04:06:37.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39812024-08-28T04:06:37.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39822024-08-28T04:06:37.077ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 159199569 } })
39832024-08-28T04:06:37.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39842024-08-28T04:06:37.078ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
39852024-08-28T04:06:37.079ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39862024-08-28T04:06:37.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39872024-08-28T04:06:37.081ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39882024-08-28T04:06:37.082ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39892024-08-28T04:06:37.084ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.08941ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
39902024-08-28T04:06:37.084ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39912024-08-28T04:06:37.084ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39922024-08-28T04:06:37.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39932024-08-28T04:06:37.085ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
39942024-08-28T04:06:37.085ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39952024-08-28T04:06:37.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39962024-08-28T04:06:37.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39972024-08-28T04:06:37.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39982024-08-28T04:06:37.094ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 176339473 } })
39992024-08-28T04:06:37.096ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 03:56:37.062572876 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
40002024-08-28T04:06:37.096ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 33.568136ms iteration = 2 status = {"expiration":"2024-08-28T03:56:37.062572876Z","pruned":[]}
40012024-08-28T04:06:37.097ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 179030452 } })
40022024-08-28T04:06:37.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
40032024-08-28T04:06:37.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
40042024-08-28T04:06:37.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40052024-08-28T04:06:37.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40062024-08-28T04:06:37.114ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40072024-08-28T04:06:37.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40082024-08-28T04:06:37.120ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40092024-08-28T04:06:37.123ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40102024-08-28T04:06:37.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40112024-08-28T04:06:37.123ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40122024-08-28T04:06:37.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40132024-08-28T04:06:37.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40142024-08-28T04:06:37.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40152024-08-28T04:06:37.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40162024-08-28T04:06:37.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40172024-08-28T04:06:37.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40182024-08-28T04:06:37.128ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
40192024-08-28T04:06:37.128ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40202024-08-28T04:06:37.128ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40212024-08-28T04:06:37.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40222024-08-28T04:06:37.130ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.707709ms iteration = 3 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
40232024-08-28T04:06:37.131ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40242024-08-28T04:06:37.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40252024-08-28T04:06:37.131ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40262024-08-28T04:06:37.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40272024-08-28T04:06:37.132ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40282024-08-28T04:06:37.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40292024-08-28T04:06:37.132ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40302024-08-28T04:06:37.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40312024-08-28T04:06:37.134ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40322024-08-28T04:06:37.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40332024-08-28T04:06:37.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40342024-08-28T04:06:37.137ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40352024-08-28T04:06:37.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40362024-08-28T04:06:37.138ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40372024-08-28T04:06:37.138ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40382024-08-28T04:06:37.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40392024-08-28T04:06:37.140ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 77.316201ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40402024-08-28T04:06:37.141ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40412024-08-28T04:06:37.141ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40422024-08-28T04:06:37.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40432024-08-28T04:06:37.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40442024-08-28T04:06:37.144ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40452024-08-28T04:06:37.144ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40462024-08-28T04:06:37.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40472024-08-28T04:06:37.146ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
40482024-08-28T04:06:37.146ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
40492024-08-28T04:06:37.146ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.357798ms iteration = 2 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
40502024-08-28T04:06:37.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40512024-08-28T04:06:37.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40522024-08-28T04:06:37.147ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40532024-08-28T04:06:37.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40542024-08-28T04:06:37.148ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40552024-08-28T04:06:37.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
40562024-08-28T04:06:37.148ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40572024-08-28T04:06:37.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40582024-08-28T04:06:37.149ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40592024-08-28T04:06:37.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40602024-08-28T04:06:37.150ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
40612024-08-28T04:06:37.150ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
40622024-08-28T04:06:37.150ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.537301ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
40632024-08-28T04:06:37.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40642024-08-28T04:06:37.155ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.410693ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40652024-08-28T04:06:37.175ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40662024-08-28T04:06:37.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40672024-08-28T04:06:37.176ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
40682024-08-28T04:06:37.176ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
40692024-08-28T04:06:37.176ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
40702024-08-28T04:06:37.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40712024-08-28T04:06:37.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40722024-08-28T04:06:37.177ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
40732024-08-28T04:06:37.177ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40742024-08-28T04:06:37.177ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.569636ms iteration = 3 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
40752024-08-28T04:06:37.181ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 118.604024ms iteration = 5 status = {"physical_disks_added":0}
40762024-08-28T04:06:37.186ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40772024-08-28T04:06:37.186ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 124.302031ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40782024-08-28T04:06:37.187ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40792024-08-28T04:06:37.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40802024-08-28T04:06:37.190ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
40812024-08-28T04:06:37.190ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
40822024-08-28T04:06:37.190ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
40832024-08-28T04:06:37.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40842024-08-28T04:06:37.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40852024-08-28T04:06:37.211ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
40862024-08-28T04:06:37.213ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
40872024-08-28T04:06:37.216ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
40882024-08-28T04:06:37.216ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40892024-08-28T04:06:37.216ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c003860d-ca76-4314-8c18-91e288c71a5d", "content-length": "26", "date": "Wed, 28 Aug 2024 04:06:37 GMT"} })
40902024-08-28T04:06:37.216ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40912024-08-28T04:06:37.218ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40922024-08-28T04:06:37.254ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40932024-08-28T04:06:37.254ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 zone_address = fd00:1122:3344:101::2
40942024-08-28T04:06:37.254ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40952024-08-28T04:06:37.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40962024-08-28T04:06:37.254ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c8bd1bec-81b8-433b-8474-25c4613c1815", "content-length": "26", "date": "Wed, 28 Aug 2024 04:06:37 GMT"} })
40972024-08-28T04:06:37.254ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40982024-08-28T04:06:37.256ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
40992024-08-28T04:06:37.386ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
41002024-08-28T04:06:37.386ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41012024-08-28T04:06:37.387ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a86ec11c-6e51-4313-a922-79f5e08d4210", "content-length": "26", "date": "Wed, 28 Aug 2024 04:06:37 GMT"} })
41022024-08-28T04:06:37.387ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41032024-08-28T04:06:37.389ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41042024-08-28T04:06:37.427ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41052024-08-28T04:06:37.428ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "31ae9a69-749a-4081-886d-db8404d7913c", "content-length": "372", "date": "Wed, 28 Aug 2024 04:06:37 GMT"} })
41062024-08-28T04:06:37.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41072024-08-28T04:06:37.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41082024-08-28T04:06:37.431ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41092024-08-28T04:06:37.431ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41102024-08-28T04:06:37.431ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41112024-08-28T04:06:37.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41122024-08-28T04:06:37.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41132024-08-28T04:06:37.434ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41142024-08-28T04:06:37.434ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41152024-08-28T04:06:37.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41162024-08-28T04:06:37.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41172024-08-28T04:06:37.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41182024-08-28T04:06:37.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41192024-08-28T04:06:37.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41202024-08-28T04:06:37.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41212024-08-28T04:06:37.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41222024-08-28T04:06:37.438ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
41232024-08-28T04:06:37.438ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 375.84748ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
41242024-08-28T04:06:37.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41252024-08-28T04:06:37.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41262024-08-28T04:06:37.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41272024-08-28T04:06:37.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
41282024-08-28T04:06:37.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41292024-08-28T04:06:37.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41302024-08-28T04:06:37.442ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
41312024-08-28T04:06:37.443ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 380.869927ms iteration = 3 status = 0
41322024-08-28T04:06:37.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41332024-08-28T04:06:37.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41342024-08-28T04:06:37.448ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41352024-08-28T04:06:37.449ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "151909f2-3239-42e0-85b7-2596a7488d50", "date": "Wed, 28 Aug 2024 04:06:37 GMT"} })
41362024-08-28T04:06:37.450ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 387.76183ms iteration = 4 status = {}
41372024-08-28T04:06:37.458ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41382024-08-28T04:06:37.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41392024-08-28T04:06:37.460ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
41402024-08-28T04:06:37.461ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 398.394463ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
41412024-08-28T04:06:37.468ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41422024-08-28T04:06:37.470ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41432024-08-28T04:06:37.470ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41442024-08-28T04:06:37.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41452024-08-28T04:06:37.472ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41462024-08-28T04:06:37.474ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
41472024-08-28T04:06:37.474ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
41482024-08-28T04:06:37.474ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41492024-08-28T04:06:37.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41502024-08-28T04:06:37.474ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41512024-08-28T04:06:37.474ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41522024-08-28T04:06:37.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41532024-08-28T04:06:37.475ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
41542024-08-28T04:06:37.475ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 0 version = 2
41552024-08-28T04:06:37.475ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41562024-08-28T04:06:37.475ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41572024-08-28T04:06:37.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41582024-08-28T04:06:37.477ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41592024-08-28T04:06:37.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41602024-08-28T04:06:37.480ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41612024-08-28T04:06:37.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41622024-08-28T04:06:37.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41632024-08-28T04:06:37.480ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41642024-08-28T04:06:37.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41652024-08-28T04:06:37.487ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T04:05:35.065116Z, time_modified: 2024-08-28T04:05:35.065116Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
41662024-08-28T04:06:37.487ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 425.078036ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]}},"default_endpoint":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
41672024-08-28T04:06:37.504ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 441.623562ms iteration = 3 status = {}
41682024-08-28T04:06:37.528ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
41692024-08-28T04:06:37.529ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5b8ae4a7-90d8-4884-a81a-e4ea33bf781a", "date": "Wed, 28 Aug 2024 04:06:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41702024-08-28T04:06:37.529ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41712024-08-28T04:06:37.531ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "39d9da9f-4932-4b98-bb97-1e5f9bd851be", "date": "Wed, 28 Aug 2024 04:06:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41722024-08-28T04:06:37.531ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41732024-08-28T04:06:37.532ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41742024-08-28T04:06:37.532ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 469.81882ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41752024-08-28T04:06:37.615ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41762024-08-28T04:06:37.618ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 1 version = 2
41772024-08-28T04:06:37.618ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
41782024-08-28T04:06:37.618ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 04:05:50.133665 UTC dns_group = external generation = 2
41792024-08-28T04:06:37.618ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 555.652932ms iteration = 3 status = {"generation":2}
41802024-08-28T04:06:37.618ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
41812024-08-28T04:06:37.618ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41822024-08-28T04:06:37.618ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 04:05:49.286960 UTC dns_group = internal generation = 1
41832024-08-28T04:06:37.618ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 555.711173ms iteration = 3 status = {"generation":1}
41842024-08-28T04:06:37.665ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41852024-08-28T04:06:37.665ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9b182e1b-9229-4169-b0bb-bef5afe9d973", "content-length": "1", "date": "Wed, 28 Aug 2024 04:06:37 GMT"} })
41862024-08-28T04:06:37.666ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41872024-08-28T04:06:37.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41882024-08-28T04:06:37.670ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
41892024-08-28T04:06:37.671ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 608.987687ms iteration = 3 status = null
41902024-08-28T04:06:37.671ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9e0b4274-88ee-4a16-857c-55961b1714b0", "date": "Wed, 28 Aug 2024 04:06:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41912024-08-28T04:06:37.671ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41922024-08-28T04:06:37.672ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41932024-08-28T04:06:37.672ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3ab15072-b8d2-411f-aabf-17ea9a6cd01a", "date": "Wed, 28 Aug 2024 04:06:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41942024-08-28T04:06:37.672ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41952024-08-28T04:06:37.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41962024-08-28T04:06:37.674ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "95a4e14b-b08f-4ed3-9284-3b08a4466c74", "date": "Wed, 28 Aug 2024 04:06:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41972024-08-28T04:06:37.674ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41982024-08-28T04:06:37.674ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 21872882-9c7e-4a12-8d80-3d3b1686a012, rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(726f0c10-a692-46cf-962b-4ac9a2a107fc) } rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
41992024-08-28T04:06:37.675ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42002024-08-28T04:06:37.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42012024-08-28T04:06:37.675ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
42022024-08-28T04:06:37.675ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 612.889042ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
42032024-08-28T04:06:37.684ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42042024-08-28T04:06:37.684ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f1e6542b-0097-414d-9e5d-70e8564fec4f", "content-length": "121", "date": "Wed, 28 Aug 2024 04:06:37 GMT"} })
42052024-08-28T04:06:37.684ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
42062024-08-28T04:06:37.684ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 726f0c10-a692-46cf-962b-4ac9a2a107fc
42072024-08-28T04:06:37.684ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42082024-08-28T04:06:37.685ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42092024-08-28T04:06:37.685ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
42102024-08-28T04:06:37.685ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
42112024-08-28T04:06:37.685ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
42122024-08-28T04:06:37.685ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42132024-08-28T04:06:37.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42142024-08-28T04:06:37.686ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42152024-08-28T04:06:37.687ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7cfc1980-8170-4051-b15a-239d3ab4e9e6", "content-length": "2", "date": "Wed, 28 Aug 2024 04:06:37 GMT"} })
42162024-08-28T04:06:37.687ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42172024-08-28T04:06:37.687ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "14dcfaf9-adff-48a4-b3b3-cc45444752da", "content-length": "50", "date": "Wed, 28 Aug 2024 04:06:37 GMT"} })
42182024-08-28T04:06:37.687ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
42192024-08-28T04:06:37.687ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42202024-08-28T04:06:37.687ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b1fcb9df-284f-4924-9d91-ea8bdaeb8fc2", "content-length": "691", "date": "Wed, 28 Aug 2024 04:06:37 GMT"} })
42212024-08-28T04:06:37.687ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
42222024-08-28T04:06:37.687ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
42232024-08-28T04:06:37.687ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
42242024-08-28T04:06:37.689ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 626.455471ms iteration = 3 status = {}
42252024-08-28T04:06:37.778ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5d5e9ac9-d8f5-4f69-b715-2aeef45d28c6", "date": "Wed, 28 Aug 2024 04:06:37 GMT"} })
42262024-08-28T04:06:37.778ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch = Switch0
42272024-08-28T04:06:37.778ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42282024-08-28T04:06:37.778ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9a35b77c-ec33-4d53-a739-4cfbe675b4b5", "content-length": "667", "date": "Wed, 28 Aug 2024 04:06:37 GMT"} })
42292024-08-28T04:06:37.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42302024-08-28T04:06:37.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42312024-08-28T04:06:37.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42322024-08-28T04:06:37.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42332024-08-28T04:06:37.793ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42342024-08-28T04:06:37.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42352024-08-28T04:06:37.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42362024-08-28T04:06:37.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42372024-08-28T04:06:37.802ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 739.975485ms iteration = 3 status = {}
42382024-08-28T04:06:41.109ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1218 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = a2c40b7a-4f58-453c-ba83-2cfa37482aeb response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
42392024-08-28T04:06:45.557ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:59821
42402024-08-28T04:06:45.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59821 req_id = 496fffef-cebc-4613-bdfb-0157d389e853 roles = RoleSet { roles: {} } uri = /metrics/producers
42412024-08-28T04:06:45.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59821 req_id = 496fffef-cebc-4613-bdfb-0157d389e853 resource = Database result = Ok(()) uri = /metrics/producers
42422024-08-28T04:06:45.592ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
42432024-08-28T04:06:45.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59821 req_id = 496fffef-cebc-4613-bdfb-0157d389e853 roles = RoleSet { roles: {} } uri = /metrics/producers
42442024-08-28T04:06:45.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59821 req_id = 496fffef-cebc-4613-bdfb-0157d389e853 resource = Database result = Ok(()) uri = /metrics/producers
42452024-08-28T04:06:45.627ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
42462024-08-28T04:06:45.629ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a8b6f8e7-f042-4eaa-b60e-027087680952", "date": "Wed, 28 Aug 2024 04:06:45 GMT"} })
42472024-08-28T04:06:45.629ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = e29f29d2-885c-4b33-aca8-4c86de0266cb
42482024-08-28T04:06:45.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 70809 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59821 req_id = 496fffef-cebc-4613-bdfb-0157d389e853 response_code = 201 uri = /metrics/producers
42492024-08-28T04:06:47.062ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
42502024-08-28T04:06:47.062ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
42512024-08-28T04:06:47.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42522024-08-28T04:06:47.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42532024-08-28T04:06:47.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42542024-08-28T04:06:47.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42552024-08-28T04:06:47.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42562024-08-28T04:06:47.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42572024-08-28T04:06:47.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42582024-08-28T04:06:47.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42592024-08-28T04:06:47.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42602024-08-28T04:06:47.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42612024-08-28T04:06:47.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42622024-08-28T04:06:47.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
42632024-08-28T04:06:47.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42642024-08-28T04:06:47.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42652024-08-28T04:06:47.081ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
42662024-08-28T04:06:47.081ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.441041ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
42672024-08-28T04:06:47.089ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42682024-08-28T04:06:47.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42692024-08-28T04:06:47.115ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.112221ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42702024-08-28T04:06:51.109ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1196 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 65118001-5136-4bc5-b417-070b1bf64f22 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
42712024-08-28T04:06:57.062ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
42722024-08-28T04:06:57.062ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
42732024-08-28T04:06:57.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42742024-08-28T04:06:57.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42752024-08-28T04:06:57.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42762024-08-28T04:06:57.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42772024-08-28T04:06:57.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42782024-08-28T04:06:57.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42792024-08-28T04:06:57.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42802024-08-28T04:06:57.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42812024-08-28T04:06:57.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42822024-08-28T04:06:57.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42832024-08-28T04:06:57.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42842024-08-28T04:06:57.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
42852024-08-28T04:06:57.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42862024-08-28T04:06:57.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42872024-08-28T04:06:57.082ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
42882024-08-28T04:06:57.082ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.124542ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
42892024-08-28T04:06:57.094ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42902024-08-28T04:06:57.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42912024-08-28T04:06:57.121ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.181948ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42922024-08-28T04:07:01.109ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1498 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 75b65d2f-329a-45a8-bd03-00babe4ec6e9 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
42932024-08-28T04:07:03.619ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45400
42942024-08-28T04:07:03.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45400 req_id = ed077397-84fb-4805-9fd8-02dfa3cf0a3b roles = RoleSet { roles: {} } uri = /metrics/producers
42952024-08-28T04:07:03.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45400 req_id = ed077397-84fb-4805-9fd8-02dfa3cf0a3b resource = Database result = Ok(()) uri = /metrics/producers
42962024-08-28T04:07:03.666ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
42972024-08-28T04:07:03.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45400 req_id = ed077397-84fb-4805-9fd8-02dfa3cf0a3b roles = RoleSet { roles: {} } uri = /metrics/producers
42982024-08-28T04:07:03.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45400 req_id = ed077397-84fb-4805-9fd8-02dfa3cf0a3b resource = Database result = Ok(()) uri = /metrics/producers
42992024-08-28T04:07:03.699ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
43002024-08-28T04:07:03.699ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "893e7710-5f7f-4594-a93c-f000871cb950", "date": "Wed, 28 Aug 2024 04:07:03 GMT"} })
43012024-08-28T04:07:03.699ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 0e1d8d78-006e-4d11-afc1-f62f97ae2dc4
43022024-08-28T04:07:03.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 73734 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45400 req_id = ed077397-84fb-4805-9fd8-02dfa3cf0a3b response_code = 201 uri = /metrics/producers
43032024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
43042024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
43052024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43062024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43072024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43082024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
43092024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43102024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
43112024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
43122024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43132024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
43142024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
43152024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43162024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
43172024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43182024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
43192024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43202024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
43212024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
43222024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43232024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
43242024-08-28T04:07:07.062ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
43252024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43262024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
43272024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
43282024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43292024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43302024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
43312024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43322024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
43332024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43342024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
43352024-08-28T04:07:07.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43362024-08-28T04:07:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43372024-08-28T04:07:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43382024-08-28T04:07:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43392024-08-28T04:07:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43402024-08-28T04:07:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43412024-08-28T04:07:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43422024-08-28T04:07:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43432024-08-28T04:07:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43442024-08-28T04:07:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43452024-08-28T04:07:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43462024-08-28T04:07:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43472024-08-28T04:07:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43482024-08-28T04:07:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43492024-08-28T04:07:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43502024-08-28T04:07:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43512024-08-28T04:07:07.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43522024-08-28T04:07:07.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43532024-08-28T04:07:07.066ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.148642ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43542024-08-28T04:07:07.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43552024-08-28T04:07:07.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43562024-08-28T04:07:07.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43572024-08-28T04:07:07.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43582024-08-28T04:07:07.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43592024-08-28T04:07:07.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43602024-08-28T04:07:07.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43612024-08-28T04:07:07.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43622024-08-28T04:07:07.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43632024-08-28T04:07:07.073ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43642024-08-28T04:07:07.075ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1114, tv_nsec: 157193680 } })
43652024-08-28T04:07:07.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43662024-08-28T04:07:07.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43672024-08-28T04:07:07.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43682024-08-28T04:07:07.076ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
43692024-08-28T04:07:07.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43702024-08-28T04:07:07.077ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43712024-08-28T04:07:07.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43722024-08-28T04:07:07.077ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1114, tv_nsec: 159423156 } })
43732024-08-28T04:07:07.077ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
43742024-08-28T04:07:07.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43752024-08-28T04:07:07.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43762024-08-28T04:07:07.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43772024-08-28T04:07:07.086ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43782024-08-28T04:07:07.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43792024-08-28T04:07:07.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43802024-08-28T04:07:07.089ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1114, tv_nsec: 171683956 } })
43812024-08-28T04:07:07.090ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
43822024-08-28T04:07:07.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.610923ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
43832024-08-28T04:07:07.112ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
43842024-08-28T04:07:07.112ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43852024-08-28T04:07:07.112ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43862024-08-28T04:07:07.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43872024-08-28T04:07:07.114ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43882024-08-28T04:07:07.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43892024-08-28T04:07:07.115ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43902024-08-28T04:07:07.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43912024-08-28T04:07:07.118ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43922024-08-28T04:07:07.118ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43932024-08-28T04:07:07.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43942024-08-28T04:07:07.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43952024-08-28T04:07:07.120ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43962024-08-28T04:07:07.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43972024-08-28T04:07:07.122ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43982024-08-28T04:07:07.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43992024-08-28T04:07:07.124ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44002024-08-28T04:07:07.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44012024-08-28T04:07:07.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44022024-08-28T04:07:07.125ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44032024-08-28T04:07:07.125ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44042024-08-28T04:07:07.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44052024-08-28T04:07:07.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44062024-08-28T04:07:07.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44072024-08-28T04:07:07.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44082024-08-28T04:07:07.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44092024-08-28T04:07:07.130ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44102024-08-28T04:07:07.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44112024-08-28T04:07:07.132ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44122024-08-28T04:07:07.134ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.765818ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44132024-08-28T04:07:07.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
44142024-08-28T04:07:07.135ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44152024-08-28T04:07:07.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44162024-08-28T04:07:07.145ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
44172024-08-28T04:07:07.145ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.215865ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
44182024-08-28T04:07:07.151ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
44192024-08-28T04:07:07.151ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44202024-08-28T04:07:07.151ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 89.304233ms iteration = 4 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
44212024-08-28T04:07:07.155ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
44222024-08-28T04:07:07.155ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 92.836437ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
44232024-08-28T04:07:07.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44242024-08-28T04:07:07.162ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44252024-08-28T04:07:07.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44262024-08-28T04:07:07.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44272024-08-28T04:07:07.165ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 102.178771ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
44282024-08-28T04:07:07.165ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.592553ms iteration = 4 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
44292024-08-28T04:07:07.169ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
44302024-08-28T04:07:07.169ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44312024-08-28T04:07:07.170ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8b10c3d4-bf1f-4877-8bab-b946a396fdbd", "content-length": "26", "date": "Wed, 28 Aug 2024 04:07:06 GMT"} })
44322024-08-28T04:07:07.170ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44332024-08-28T04:07:07.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44342024-08-28T04:07:07.171ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
44352024-08-28T04:07:07.171ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44362024-08-28T04:07:07.172ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44372024-08-28T04:07:07.172ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4549de33-da8a-494b-b09d-18b9abd974ca", "content-length": "26", "date": "Wed, 28 Aug 2024 04:07:06 GMT"} })
44382024-08-28T04:07:07.172ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44392024-08-28T04:07:07.173ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44402024-08-28T04:07:07.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
44412024-08-28T04:07:07.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44422024-08-28T04:07:07.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44432024-08-28T04:07:07.176ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 zone_address = fd00:1122:3344:101::2
44442024-08-28T04:07:07.176ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44452024-08-28T04:07:07.176ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "698024b8-8d93-4b5b-99d4-1c12c31bc82a", "content-length": "26", "date": "Wed, 28 Aug 2024 04:07:06 GMT"} })
44462024-08-28T04:07:07.176ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44472024-08-28T04:07:07.177ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 114.266016ms iteration = 4 status = 0
44482024-08-28T04:07:07.177ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
44492024-08-28T04:07:07.211ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44502024-08-28T04:07:07.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44512024-08-28T04:07:07.214ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44522024-08-28T04:07:07.214ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 151.737127ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44532024-08-28T04:07:07.224ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 162.173904ms iteration = 4 status = {}
44542024-08-28T04:07:07.230ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.570452ms iteration = 6 status = {"physical_disks_added":0}
44552024-08-28T04:07:07.234ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44562024-08-28T04:07:07.235ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e7324040-0501-48da-bcfd-637df2373ce2", "content-length": "1", "date": "Wed, 28 Aug 2024 04:07:06 GMT"} })
44572024-08-28T04:07:07.236ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44582024-08-28T04:07:07.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44592024-08-28T04:07:07.278ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44602024-08-28T04:07:07.278ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "daac89d3-b9d3-445e-bf3f-63913f19a91f", "content-length": "372", "date": "Wed, 28 Aug 2024 04:07:06 GMT"} })
44612024-08-28T04:07:07.278ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44622024-08-28T04:07:07.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44632024-08-28T04:07:07.280ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 217.584921ms iteration = 4 status = null
44642024-08-28T04:07:07.281ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44652024-08-28T04:07:07.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44662024-08-28T04:07:07.284ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44672024-08-28T04:07:07.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44682024-08-28T04:07:07.287ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44692024-08-28T04:07:07.288ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5f074b15-46b9-4049-98cf-5db989cac296", "date": "Wed, 28 Aug 2024 04:07:06 GMT"} })
44702024-08-28T04:07:07.288ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 226.05368ms iteration = 5 status = {}
44712024-08-28T04:07:07.297ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44722024-08-28T04:07:07.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44732024-08-28T04:07:07.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44742024-08-28T04:07:07.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44752024-08-28T04:07:07.309ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 21872882-9c7e-4a12-8d80-3d3b1686a012, rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(726f0c10-a692-46cf-962b-4ac9a2a107fc) } rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
44762024-08-28T04:07:07.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44772024-08-28T04:07:07.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44782024-08-28T04:07:07.317ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44792024-08-28T04:07:07.318ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "92ce2574-24ff-4e02-8d8c-7d9628bb41a8", "content-length": "121", "date": "Wed, 28 Aug 2024 04:07:06 GMT"} })
44802024-08-28T04:07:07.318ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
44812024-08-28T04:07:07.318ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 726f0c10-a692-46cf-962b-4ac9a2a107fc
44822024-08-28T04:07:07.318ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44832024-08-28T04:07:07.318ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44842024-08-28T04:07:07.318ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
44852024-08-28T04:07:07.318ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
44862024-08-28T04:07:07.318ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
44872024-08-28T04:07:07.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44882024-08-28T04:07:07.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44892024-08-28T04:07:07.322ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44902024-08-28T04:07:07.324ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44912024-08-28T04:07:07.324ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44922024-08-28T04:07:07.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44932024-08-28T04:07:07.326ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44942024-08-28T04:07:07.327ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44952024-08-28T04:07:07.327ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44962024-08-28T04:07:07.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44972024-08-28T04:07:07.332ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44982024-08-28T04:07:07.332ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ff42e67c-356b-4aa9-b1aa-6dc627a1aec6", "content-length": "2", "date": "Wed, 28 Aug 2024 04:07:06 GMT"} })
44992024-08-28T04:07:07.332ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45002024-08-28T04:07:07.333ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0ba72460-10b9-421a-863c-885af6affd18", "content-length": "50", "date": "Wed, 28 Aug 2024 04:07:06 GMT"} })
45012024-08-28T04:07:07.333ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
45022024-08-28T04:07:07.333ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45032024-08-28T04:07:07.360ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45042024-08-28T04:07:07.429ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5de1d2aa-83a6-4a54-a6b4-099d3502fab6", "date": "Wed, 28 Aug 2024 04:07:06 GMT"} })
45052024-08-28T04:07:07.429ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch = Switch0
45062024-08-28T04:07:07.429ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45072024-08-28T04:07:07.429ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7042f86c-ccfc-4795-8705-56da453efc27", "content-length": "691", "date": "Wed, 28 Aug 2024 04:07:06 GMT"} })
45082024-08-28T04:07:07.429ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
45092024-08-28T04:07:07.429ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
45102024-08-28T04:07:07.429ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
45112024-08-28T04:07:07.429ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3888b445-ce2d-4fe1-bd5b-49d1227f90ae", "content-length": "667", "date": "Wed, 28 Aug 2024 04:07:06 GMT"} })
45122024-08-28T04:07:07.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45132024-08-28T04:07:07.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45142024-08-28T04:07:07.430ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 368.02602ms iteration = 4 status = {}
45152024-08-28T04:07:07.434ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45162024-08-28T04:07:07.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45172024-08-28T04:07:07.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45182024-08-28T04:07:07.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45192024-08-28T04:07:07.439ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45202024-08-28T04:07:07.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45212024-08-28T04:07:07.447ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 384.631968ms iteration = 4 status = {}
45222024-08-28T04:07:11.110ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = f3611131-0885-4073-95bb-b694d5e6b547 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
45232024-08-28T04:07:17.062ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
45242024-08-28T04:07:17.062ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
45252024-08-28T04:07:17.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45262024-08-28T04:07:17.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45272024-08-28T04:07:17.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45282024-08-28T04:07:17.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45292024-08-28T04:07:17.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45302024-08-28T04:07:17.065ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45312024-08-28T04:07:17.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45322024-08-28T04:07:17.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45332024-08-28T04:07:17.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45342024-08-28T04:07:17.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45352024-08-28T04:07:17.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45362024-08-28T04:07:17.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45372024-08-28T04:07:17.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45382024-08-28T04:07:17.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
45392024-08-28T04:07:17.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45402024-08-28T04:07:17.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45412024-08-28T04:07:17.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
45422024-08-28T04:07:17.079ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.963458ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
45432024-08-28T04:07:17.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.559129ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45442024-08-28T04:07:21.109ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1437 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 77fa11b5-4cad-4ea4-a391-42b66b3aab63 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
45452024-08-28T04:07:26.365ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:56913
45462024-08-28T04:07:26.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56913 req_id = e921ea1e-82dd-41f1-afed-d3506d86a52f roles = RoleSet { roles: {} } uri = /metrics/producers
45472024-08-28T04:07:26.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56913 req_id = e921ea1e-82dd-41f1-afed-d3506d86a52f resource = Database result = Ok(()) uri = /metrics/producers
45482024-08-28T04:07:26.406ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
45492024-08-28T04:07:26.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56913 req_id = e921ea1e-82dd-41f1-afed-d3506d86a52f roles = RoleSet { roles: {} } uri = /metrics/producers
45502024-08-28T04:07:26.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56913 req_id = e921ea1e-82dd-41f1-afed-d3506d86a52f resource = Database result = Ok(()) uri = /metrics/producers
45512024-08-28T04:07:26.440ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
45522024-08-28T04:07:26.441ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "090e32ad-8839-4a12-9010-2f72f6736185", "date": "Wed, 28 Aug 2024 04:07:26 GMT"} })
45532024-08-28T04:07:26.441ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 5c7c3da2-1911-473e-8087-8b75e35a21c4
45542024-08-28T04:07:26.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 79419 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56913 req_id = e921ea1e-82dd-41f1-afed-d3506d86a52f response_code = 201 uri = /metrics/producers
45552024-08-28T04:07:27.062ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
45562024-08-28T04:07:27.062ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
45572024-08-28T04:07:27.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45582024-08-28T04:07:27.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45592024-08-28T04:07:27.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45602024-08-28T04:07:27.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45612024-08-28T04:07:27.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45622024-08-28T04:07:27.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45632024-08-28T04:07:27.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45642024-08-28T04:07:27.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45652024-08-28T04:07:27.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45662024-08-28T04:07:27.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45672024-08-28T04:07:27.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45682024-08-28T04:07:27.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
45692024-08-28T04:07:27.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45702024-08-28T04:07:27.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45712024-08-28T04:07:27.081ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
45722024-08-28T04:07:27.081ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.914526ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
45732024-08-28T04:07:27.088ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45742024-08-28T04:07:27.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45752024-08-28T04:07:27.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.996812ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45762024-08-28T04:07:31.109ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1836 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = b8394d3f-b1b0-4c9f-8014-d4774f396b2c response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
45772024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
45782024-08-28T04:07:37.062ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
45792024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
45802024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45812024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45822024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
45832024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
45842024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
45852024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45862024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
45872024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
45882024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
45892024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
45902024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
45912024-08-28T04:07:37.062ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
45922024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
45932024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
45942024-08-28T04:07:37.062ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
45952024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
45962024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
45972024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
45982024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45992024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46002024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
46012024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
46022024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46032024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46042024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
46052024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46062024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
46072024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46082024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
46092024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
46102024-08-28T04:07:37.062ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764
46112024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46122024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
46132024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.65\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764"}
46142024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
46152024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
46162024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
46172024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46182024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46192024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
46202024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
46212024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46222024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
46232024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
46242024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46252024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
46262024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46272024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
46282024-08-28T04:07:37.062ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 03:57:37.062531342 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
46292024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
46302024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
46312024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46322024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
46332024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
46342024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46352024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46362024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46372024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46382024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46392024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
46402024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
46412024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46422024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46432024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46442024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46452024-08-28T04:07:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46462024-08-28T04:07:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46472024-08-28T04:07:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46482024-08-28T04:07:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46492024-08-28T04:07:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46502024-08-28T04:07:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46512024-08-28T04:07:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46522024-08-28T04:07:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46532024-08-28T04:07:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
46542024-08-28T04:07:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46552024-08-28T04:07:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46562024-08-28T04:07:37.063ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4eb364e4-14a2-46c4-b173-eb2890920e8f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1144, tv_nsec: 145371363 } })
46572024-08-28T04:07:37.063ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("037b07ce-9e39-4982-8c20-c4c38f448b97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4e2ba65e-422a-4b1e-b0e3-85f8149a979a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1144, tv_nsec: 145401234 } })
46582024-08-28T04:07:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
46592024-08-28T04:07:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46602024-08-28T04:07:37.067ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
46612024-08-28T04:07:37.067ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 5.405669ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
46622024-08-28T04:07:37.067ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
46632024-08-28T04:07:37.067ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.173442ms iteration = 4 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
46642024-08-28T04:07:37.071ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46652024-08-28T04:07:37.074ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46662024-08-28T04:07:37.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46672024-08-28T04:07:37.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
46682024-08-28T04:07:37.074ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
46692024-08-28T04:07:37.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
46702024-08-28T04:07:37.079ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.184705ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
46712024-08-28T04:07:37.079ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46722024-08-28T04:07:37.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46732024-08-28T04:07:37.082ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 19.902025ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46742024-08-28T04:07:37.083ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46752024-08-28T04:07:37.083ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46762024-08-28T04:07:37.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46772024-08-28T04:07:37.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46782024-08-28T04:07:37.083ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46792024-08-28T04:07:37.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46802024-08-28T04:07:37.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46812024-08-28T04:07:37.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46822024-08-28T04:07:37.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46832024-08-28T04:07:37.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46842024-08-28T04:07:37.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46852024-08-28T04:07:37.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46862024-08-28T04:07:37.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46872024-08-28T04:07:37.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46882024-08-28T04:07:37.095ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1144, tv_nsec: 177278860 } })
46892024-08-28T04:07:37.095ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
46902024-08-28T04:07:37.099ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 03:57:37.062531342 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
46912024-08-28T04:07:37.099ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 37.401209ms iteration = 3 status = {"expiration":"2024-08-28T03:57:37.062531342Z","pruned":[]}
46922024-08-28T04:07:37.101ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1144, tv_nsec: 183537114 } })
46932024-08-28T04:07:37.101ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
46942024-08-28T04:07:37.104ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46952024-08-28T04:07:37.107ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46962024-08-28T04:07:37.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46972024-08-28T04:07:37.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46982024-08-28T04:07:37.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46992024-08-28T04:07:37.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47002024-08-28T04:07:37.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47012024-08-28T04:07:37.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47022024-08-28T04:07:37.124ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
47032024-08-28T04:07:37.125ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47042024-08-28T04:07:37.125ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47052024-08-28T04:07:37.125ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47062024-08-28T04:07:37.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47072024-08-28T04:07:37.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47082024-08-28T04:07:37.128ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47092024-08-28T04:07:37.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47102024-08-28T04:07:37.131ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47112024-08-28T04:07:37.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47122024-08-28T04:07:37.135ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47132024-08-28T04:07:37.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47142024-08-28T04:07:37.138ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47152024-08-28T04:07:37.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47162024-08-28T04:07:37.140ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47172024-08-28T04:07:37.140ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
47182024-08-28T04:07:37.140ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
47192024-08-28T04:07:37.141ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 78.718413ms iteration = 3 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
47202024-08-28T04:07:37.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47212024-08-28T04:07:37.142ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47222024-08-28T04:07:37.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47232024-08-28T04:07:37.145ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47242024-08-28T04:07:37.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47252024-08-28T04:07:37.147ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47262024-08-28T04:07:37.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47272024-08-28T04:07:37.150ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47282024-08-28T04:07:37.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47292024-08-28T04:07:37.153ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47302024-08-28T04:07:37.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47312024-08-28T04:07:37.158ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 96.142884ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47322024-08-28T04:07:37.159ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
47332024-08-28T04:07:37.161ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47342024-08-28T04:07:37.161ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 98.828363ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
47352024-08-28T04:07:37.161ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47362024-08-28T04:07:37.161ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
47372024-08-28T04:07:37.161ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
47382024-08-28T04:07:37.161ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 99.303967ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
47392024-08-28T04:07:37.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47402024-08-28T04:07:37.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47412024-08-28T04:07:37.201ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
47422024-08-28T04:07:37.201ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
47432024-08-28T04:07:37.201ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
47442024-08-28T04:07:37.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47452024-08-28T04:07:37.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47462024-08-28T04:07:37.202ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
47472024-08-28T04:07:37.202ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
47482024-08-28T04:07:37.202ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
47492024-08-28T04:07:37.202ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47502024-08-28T04:07:37.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47512024-08-28T04:07:37.210ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47522024-08-28T04:07:37.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47532024-08-28T04:07:37.220ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
47542024-08-28T04:07:37.240ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
47552024-08-28T04:07:37.240ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47562024-08-28T04:07:37.240ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "264aef75-3182-47c5-8535-bc1237678fbd", "content-length": "26", "date": "Wed, 28 Aug 2024 04:07:36 GMT"} })
47572024-08-28T04:07:37.240ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47582024-08-28T04:07:37.242ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47592024-08-28T04:07:37.284ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47602024-08-28T04:07:37.285ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6680f8ef-1d63-4d63-ac04-89871b8954c8", "content-length": "372", "date": "Wed, 28 Aug 2024 04:07:36 GMT"} })
47612024-08-28T04:07:37.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47622024-08-28T04:07:37.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47632024-08-28T04:07:37.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47642024-08-28T04:07:37.289ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 226.759761ms iteration = 5 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
47652024-08-28T04:07:37.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
47662024-08-28T04:07:37.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47672024-08-28T04:07:37.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47682024-08-28T04:07:37.290ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47692024-08-28T04:07:37.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47702024-08-28T04:07:37.291ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1144, tv_nsec: 373685729 } })
47712024-08-28T04:07:37.291ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
47722024-08-28T04:07:37.291ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47732024-08-28T04:07:37.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47742024-08-28T04:07:37.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47752024-08-28T04:07:37.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47762024-08-28T04:07:37.294ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47772024-08-28T04:07:37.294ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47782024-08-28T04:07:37.295ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47792024-08-28T04:07:37.295ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 233.072396ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47802024-08-28T04:07:37.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47812024-08-28T04:07:37.296ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47822024-08-28T04:07:37.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47832024-08-28T04:07:37.296ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47842024-08-28T04:07:37.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47852024-08-28T04:07:37.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
47862024-08-28T04:07:37.299ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47872024-08-28T04:07:37.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47882024-08-28T04:07:37.301ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
47892024-08-28T04:07:37.301ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 239.208376ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
47902024-08-28T04:07:37.303ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47912024-08-28T04:07:37.305ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "75bfb99f-7a7c-4a3c-92e7-d1c631f06ee4", "date": "Wed, 28 Aug 2024 04:07:36 GMT"} })
47922024-08-28T04:07:37.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47932024-08-28T04:07:37.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47942024-08-28T04:07:37.306ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 244.481652ms iteration = 6 status = {}
47952024-08-28T04:07:37.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47962024-08-28T04:07:37.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47972024-08-28T04:07:37.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47982024-08-28T04:07:37.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
47992024-08-28T04:07:37.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48002024-08-28T04:07:37.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48012024-08-28T04:07:37.315ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48022024-08-28T04:07:37.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48032024-08-28T04:07:37.317ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 254.826465ms iteration = 5 status = 0
48042024-08-28T04:07:37.317ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
48052024-08-28T04:07:37.318ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
48062024-08-28T04:07:37.318ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
48072024-08-28T04:07:37.318ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 256.650459ms iteration = 5 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
48082024-08-28T04:07:37.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48092024-08-28T04:07:37.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48102024-08-28T04:07:37.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48112024-08-28T04:07:37.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48122024-08-28T04:07:37.328ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 266.102877ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
48132024-08-28T04:07:37.332ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48142024-08-28T04:07:37.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48152024-08-28T04:07:37.336ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48162024-08-28T04:07:37.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48172024-08-28T04:07:37.338ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48182024-08-28T04:07:37.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48192024-08-28T04:07:37.340ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48202024-08-28T04:07:37.341ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
48212024-08-28T04:07:37.341ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48222024-08-28T04:07:37.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48232024-08-28T04:07:37.355ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
48242024-08-28T04:07:37.355ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 293.336486ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
48252024-08-28T04:07:37.366ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
48262024-08-28T04:07:37.366ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
48272024-08-28T04:07:37.366ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48282024-08-28T04:07:37.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48292024-08-28T04:07:37.370ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
48302024-08-28T04:07:37.370ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 0 version = 2
48312024-08-28T04:07:37.370ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48322024-08-28T04:07:37.370ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48332024-08-28T04:07:37.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48342024-08-28T04:07:37.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48352024-08-28T04:07:37.373ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48362024-08-28T04:07:37.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48372024-08-28T04:07:37.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48382024-08-28T04:07:37.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48392024-08-28T04:07:37.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48402024-08-28T04:07:37.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48412024-08-28T04:07:37.377ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
48422024-08-28T04:07:37.377ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
48432024-08-28T04:07:37.377ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 04:05:49.286960 UTC dns_group = internal generation = 1
48442024-08-28T04:07:37.377ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 314.647212ms iteration = 4 status = {"generation":1}
48452024-08-28T04:07:37.378ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 1 version = 2
48462024-08-28T04:07:37.378ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
48472024-08-28T04:07:37.378ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 04:05:50.133665 UTC dns_group = external generation = 2
48482024-08-28T04:07:37.378ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 315.765035ms iteration = 4 status = {"generation":2}
48492024-08-28T04:07:37.378ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T04:05:35.065116Z, time_modified: 2024-08-28T04:05:35.065116Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
48502024-08-28T04:07:37.378ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 316.046834ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]}},"default_endpoint":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
48512024-08-28T04:07:37.401ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48522024-08-28T04:07:37.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48532024-08-28T04:07:37.404ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48542024-08-28T04:07:37.407ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48552024-08-28T04:07:37.407ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48562024-08-28T04:07:37.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48572024-08-28T04:07:37.408ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
48582024-08-28T04:07:37.408ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48592024-08-28T04:07:37.408ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48602024-08-28T04:07:37.409ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1f55d4c0-8a33-445e-8e50-d190699eedb2", "content-length": "26", "date": "Wed, 28 Aug 2024 04:07:36 GMT"} })
48612024-08-28T04:07:37.409ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48622024-08-28T04:07:37.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48632024-08-28T04:07:37.410ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48642024-08-28T04:07:37.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48652024-08-28T04:07:37.411ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48662024-08-28T04:07:37.412ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 350.33601ms iteration = 7 status = {"physical_disks_added":0}
48672024-08-28T04:07:37.412ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48682024-08-28T04:07:37.413ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8d8f4301-895d-4e8f-919b-3b1dfebf2250", "content-length": "1", "date": "Wed, 28 Aug 2024 04:07:36 GMT"} })
48692024-08-28T04:07:37.414ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48702024-08-28T04:07:37.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48712024-08-28T04:07:37.417ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 354.421301ms iteration = 5 status = null
48722024-08-28T04:07:37.428ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 zone_address = fd00:1122:3344:101::2
48732024-08-28T04:07:37.428ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48742024-08-28T04:07:37.428ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "07fcc2ba-4af1-4c21-9ecd-8def315f90f6", "content-length": "26", "date": "Wed, 28 Aug 2024 04:07:36 GMT"} })
48752024-08-28T04:07:37.428ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48762024-08-28T04:07:37.429ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
48772024-08-28T04:07:37.439ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
48782024-08-28T04:07:37.440ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "48a707a6-76ac-4322-bcaf-4f5d484900eb", "date": "Wed, 28 Aug 2024 04:07:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
48792024-08-28T04:07:37.440ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
48802024-08-28T04:07:37.442ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e4739c55-1c58-4f13-913a-097d60ca1f89", "date": "Wed, 28 Aug 2024 04:07:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
48812024-08-28T04:07:37.442ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
48822024-08-28T04:07:37.444ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
48832024-08-28T04:07:37.444ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 382.002561ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
48842024-08-28T04:07:37.451ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
48852024-08-28T04:07:37.452ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "240a68e1-e738-486a-9c77-e158e2c16b75", "date": "Wed, 28 Aug 2024 04:07:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
48862024-08-28T04:07:37.452ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
48872024-08-28T04:07:37.455ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "13d06417-e869-42c9-9872-c48b08d24a69", "date": "Wed, 28 Aug 2024 04:07:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
48882024-08-28T04:07:37.455ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
48892024-08-28T04:07:37.457ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "521935dd-18e0-4a3e-bdc9-3dcc42e17a14", "date": "Wed, 28 Aug 2024 04:07:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
48902024-08-28T04:07:37.457ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
48912024-08-28T04:07:37.459ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
48922024-08-28T04:07:37.459ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 397.189797ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
48932024-08-28T04:07:37.500ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 438.239983ms iteration = 5 status = {}
48942024-08-28T04:07:37.592ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
48952024-08-28T04:07:37.593ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4cb9fac1-4dc2-4b16-98d9-6de349b6becf", "content-length": "691", "date": "Wed, 28 Aug 2024 04:07:36 GMT"} })
48962024-08-28T04:07:37.593ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
48972024-08-28T04:07:37.593ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
48982024-08-28T04:07:37.593ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
48992024-08-28T04:07:37.594ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 531.877753ms iteration = 5 status = {}
49002024-08-28T04:07:37.653ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49012024-08-28T04:07:37.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49022024-08-28T04:07:37.655ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 21872882-9c7e-4a12-8d80-3d3b1686a012, rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(726f0c10-a692-46cf-962b-4ac9a2a107fc) } rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
49032024-08-28T04:07:37.655ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49042024-08-28T04:07:37.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49052024-08-28T04:07:37.664ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
49062024-08-28T04:07:37.665ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "755eb344-1d1b-4eef-abf9-423125b99d41", "content-length": "121", "date": "Wed, 28 Aug 2024 04:07:36 GMT"} })
49072024-08-28T04:07:37.665ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
49082024-08-28T04:07:37.665ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 726f0c10-a692-46cf-962b-4ac9a2a107fc
49092024-08-28T04:07:37.665ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49102024-08-28T04:07:37.665ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49112024-08-28T04:07:37.665ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
49122024-08-28T04:07:37.665ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
49132024-08-28T04:07:37.665ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
49142024-08-28T04:07:37.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49152024-08-28T04:07:37.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49162024-08-28T04:07:37.667ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
49172024-08-28T04:07:37.667ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3e56cb44-9f13-4e2b-a859-4d346f949177", "content-length": "2", "date": "Wed, 28 Aug 2024 04:07:36 GMT"} })
49182024-08-28T04:07:37.667ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
49192024-08-28T04:07:37.667ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f3f789df-b3a4-40a7-8f6f-6af339e94a89", "content-length": "50", "date": "Wed, 28 Aug 2024 04:07:36 GMT"} })
49202024-08-28T04:07:37.667ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
49212024-08-28T04:07:37.667ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
49222024-08-28T04:07:37.761ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "de602c6a-33cd-490a-a47d-fd1ac02922b6", "date": "Wed, 28 Aug 2024 04:07:36 GMT"} })
49232024-08-28T04:07:37.761ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch = Switch0
49242024-08-28T04:07:37.761ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49252024-08-28T04:07:37.765ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e63a6d79-3e35-45a4-b92a-8e6079de0380", "content-length": "667", "date": "Wed, 28 Aug 2024 04:07:37 GMT"} })
49262024-08-28T04:07:37.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49272024-08-28T04:07:37.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49282024-08-28T04:07:37.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49292024-08-28T04:07:37.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49302024-08-28T04:07:37.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49312024-08-28T04:07:37.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49322024-08-28T04:07:37.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49332024-08-28T04:07:37.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49342024-08-28T04:07:37.781ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 718.737191ms iteration = 5 status = {}
49352024-08-28T04:07:41.108ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1260 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 75b47aad-61fb-4ca4-8002-b821bfc43c81 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
49362024-08-28T04:07:46.821ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:58410
49372024-08-28T04:07:46.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58410 req_id = 8c62c184-3d7d-4d9d-b938-7e083a5d4d07 roles = RoleSet { roles: {} } uri = /metrics/producers
49382024-08-28T04:07:46.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58410 req_id = 8c62c184-3d7d-4d9d-b938-7e083a5d4d07 resource = Database result = Ok(()) uri = /metrics/producers
49392024-08-28T04:07:46.856ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
49402024-08-28T04:07:46.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58410 req_id = 8c62c184-3d7d-4d9d-b938-7e083a5d4d07 roles = RoleSet { roles: {} } uri = /metrics/producers
49412024-08-28T04:07:46.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58410 req_id = 8c62c184-3d7d-4d9d-b938-7e083a5d4d07 resource = Database result = Ok(()) uri = /metrics/producers
49422024-08-28T04:07:46.862ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
49432024-08-28T04:07:46.863ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fa98e876-331c-4825-8950-615a540e0753", "date": "Wed, 28 Aug 2024 04:07:46 GMT"} })
49442024-08-28T04:07:46.863ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = f62e5a13-51f3-4379-acf3-2f8e8601ac1f
49452024-08-28T04:07:46.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 42818 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58410 req_id = 8c62c184-3d7d-4d9d-b938-7e083a5d4d07 response_code = 201 uri = /metrics/producers
49462024-08-28T04:07:47.061ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
49472024-08-28T04:07:47.061ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
49482024-08-28T04:07:47.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49492024-08-28T04:07:47.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49502024-08-28T04:07:47.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49512024-08-28T04:07:47.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49522024-08-28T04:07:47.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49532024-08-28T04:07:47.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49542024-08-28T04:07:47.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49552024-08-28T04:07:47.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49562024-08-28T04:07:47.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49572024-08-28T04:07:47.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49582024-08-28T04:07:47.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49592024-08-28T04:07:47.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49602024-08-28T04:07:47.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49612024-08-28T04:07:47.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
49622024-08-28T04:07:47.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49632024-08-28T04:07:47.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49642024-08-28T04:07:47.086ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
49652024-08-28T04:07:47.086ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.15127ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
49662024-08-28T04:07:47.094ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.845385ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49672024-08-28T04:07:51.109ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1810 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 552784f7-6a3e-4b9c-bf46-c5883853d11c response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
49682024-08-28T04:07:57.061ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
49692024-08-28T04:07:57.062ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
49702024-08-28T04:07:57.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49712024-08-28T04:07:57.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49722024-08-28T04:07:57.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49732024-08-28T04:07:57.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49742024-08-28T04:07:57.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49752024-08-28T04:07:57.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49762024-08-28T04:07:57.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49772024-08-28T04:07:57.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49782024-08-28T04:07:57.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49792024-08-28T04:07:57.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49802024-08-28T04:07:57.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49812024-08-28T04:07:57.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49822024-08-28T04:07:57.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49832024-08-28T04:07:57.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
49842024-08-28T04:07:57.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49852024-08-28T04:07:57.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49862024-08-28T04:07:57.078ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
49872024-08-28T04:07:57.078ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.264627ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
49882024-08-28T04:07:57.095ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.70453ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49892024-08-28T04:08:01.109ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1366 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 569a7879-a5a1-487e-be60-88d79a470d38 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
49902024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
49912024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
49922024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49932024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49942024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
49952024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
49962024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49972024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49982024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
49992024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50002024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
50012024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
50022024-08-28T04:08:07.061ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
50032024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50042024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50052024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
50062024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
50072024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50082024-08-28T04:08:07.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50092024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
50102024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50112024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
50122024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50132024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
50142024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50152024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
50162024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
50172024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50182024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
50192024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50202024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50212024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
50222024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50232024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
50242024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50252024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50262024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50272024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50282024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50292024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50302024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50312024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50322024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50332024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50342024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50352024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50362024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50372024-08-28T04:08:07.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50382024-08-28T04:08:07.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.013369ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
50392024-08-28T04:08:07.065ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50402024-08-28T04:08:07.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50412024-08-28T04:08:07.065ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50422024-08-28T04:08:07.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50432024-08-28T04:08:07.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50442024-08-28T04:08:07.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50452024-08-28T04:08:07.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50462024-08-28T04:08:07.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50472024-08-28T04:08:07.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50482024-08-28T04:08:07.068ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1174, tv_nsec: 151410620 } })
50492024-08-28T04:08:07.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50502024-08-28T04:08:07.069ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.082278ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
50512024-08-28T04:08:07.069ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
50522024-08-28T04:08:07.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
50532024-08-28T04:08:07.070ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50542024-08-28T04:08:07.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50552024-08-28T04:08:07.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50562024-08-28T04:08:07.070ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50572024-08-28T04:08:07.070ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1174, tv_nsec: 153374828 } })
50582024-08-28T04:08:07.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50592024-08-28T04:08:07.071ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
50602024-08-28T04:08:07.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50612024-08-28T04:08:07.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50622024-08-28T04:08:07.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50632024-08-28T04:08:07.074ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.660222ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50642024-08-28T04:08:07.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50652024-08-28T04:08:07.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50662024-08-28T04:08:07.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50672024-08-28T04:08:07.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50682024-08-28T04:08:07.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50692024-08-28T04:08:07.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50702024-08-28T04:08:07.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50712024-08-28T04:08:07.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50722024-08-28T04:08:07.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50732024-08-28T04:08:07.078ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50742024-08-28T04:08:07.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50752024-08-28T04:08:07.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50762024-08-28T04:08:07.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50772024-08-28T04:08:07.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50782024-08-28T04:08:07.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50792024-08-28T04:08:07.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50802024-08-28T04:08:07.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50812024-08-28T04:08:07.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50822024-08-28T04:08:07.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50832024-08-28T04:08:07.086ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1174, tv_nsec: 168571715 } })
50842024-08-28T04:08:07.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50852024-08-28T04:08:07.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50862024-08-28T04:08:07.087ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
50872024-08-28T04:08:07.087ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50882024-08-28T04:08:07.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50892024-08-28T04:08:07.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50902024-08-28T04:08:07.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50912024-08-28T04:08:07.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50922024-08-28T04:08:07.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50932024-08-28T04:08:07.103ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
50942024-08-28T04:08:07.103ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50952024-08-28T04:08:07.103ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50962024-08-28T04:08:07.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50972024-08-28T04:08:07.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50982024-08-28T04:08:07.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50992024-08-28T04:08:07.107ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51002024-08-28T04:08:07.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51012024-08-28T04:08:07.110ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51022024-08-28T04:08:07.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51032024-08-28T04:08:07.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51042024-08-28T04:08:07.116ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 54.526492ms iteration = 6 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
51052024-08-28T04:08:07.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
51062024-08-28T04:08:07.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51072024-08-28T04:08:07.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51082024-08-28T04:08:07.127ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
51092024-08-28T04:08:07.127ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.398231ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
51102024-08-28T04:08:07.133ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 71.988085ms iteration = 8 status = {"physical_disks_added":0}
51112024-08-28T04:08:07.142ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51122024-08-28T04:08:07.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51132024-08-28T04:08:07.143ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51142024-08-28T04:08:07.145ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
51152024-08-28T04:08:07.145ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51162024-08-28T04:08:07.145ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 83.306127ms iteration = 6 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
51172024-08-28T04:08:07.146ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51182024-08-28T04:08:07.146ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.084799ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51192024-08-28T04:08:07.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
51202024-08-28T04:08:07.147ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51212024-08-28T04:08:07.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51222024-08-28T04:08:07.147ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.44024ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
51232024-08-28T04:08:07.151ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 90.19656ms iteration = 6 status = 0
51242024-08-28T04:08:07.174ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
51252024-08-28T04:08:07.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 112.555277ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
51262024-08-28T04:08:07.176ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
51272024-08-28T04:08:07.176ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51282024-08-28T04:08:07.177ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "96042222-accd-47e6-bbca-b7b15aa8aee1", "content-length": "26", "date": "Wed, 28 Aug 2024 04:08:07 GMT"} })
51292024-08-28T04:08:07.177ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51302024-08-28T04:08:07.179ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51312024-08-28T04:08:07.182ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
51322024-08-28T04:08:07.182ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51332024-08-28T04:08:07.183ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d4a3b4d6-9de6-4743-961c-114a678056e5", "content-length": "26", "date": "Wed, 28 Aug 2024 04:08:07 GMT"} })
51342024-08-28T04:08:07.183ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51352024-08-28T04:08:07.183ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51362024-08-28T04:08:07.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51372024-08-28T04:08:07.184ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51382024-08-28T04:08:07.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51392024-08-28T04:08:07.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51402024-08-28T04:08:07.187ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51412024-08-28T04:08:07.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51422024-08-28T04:08:07.189ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51432024-08-28T04:08:07.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51442024-08-28T04:08:07.192ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51452024-08-28T04:08:07.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51462024-08-28T04:08:07.217ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51472024-08-28T04:08:07.218ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a2747805-70e9-4826-abdf-dbda306b1eb2", "content-length": "372", "date": "Wed, 28 Aug 2024 04:08:06 GMT"} })
51482024-08-28T04:08:07.218ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51492024-08-28T04:08:07.218ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 zone_address = fd00:1122:3344:101::2
51502024-08-28T04:08:07.218ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51512024-08-28T04:08:07.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51522024-08-28T04:08:07.219ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0499182f-1158-429c-8fa0-a823263da8e9", "content-length": "26", "date": "Wed, 28 Aug 2024 04:08:07 GMT"} })
51532024-08-28T04:08:07.219ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51542024-08-28T04:08:07.220ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
51552024-08-28T04:08:07.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51562024-08-28T04:08:07.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51572024-08-28T04:08:07.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51582024-08-28T04:08:07.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51592024-08-28T04:08:07.230ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51602024-08-28T04:08:07.230ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f21dd5b4-d6a7-4728-bb67-e12eadced871", "date": "Wed, 28 Aug 2024 04:08:06 GMT"} })
51612024-08-28T04:08:07.232ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 170.419906ms iteration = 7 status = {}
51622024-08-28T04:08:07.315ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 253.250669ms iteration = 6 status = {}
51632024-08-28T04:08:07.325ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
51642024-08-28T04:08:07.325ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5e8dc8c1-106b-4bce-aa1b-0cdfdac86f48", "content-length": "1", "date": "Wed, 28 Aug 2024 04:08:06 GMT"} })
51652024-08-28T04:08:07.327ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51662024-08-28T04:08:07.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51672024-08-28T04:08:07.329ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 267.936191ms iteration = 6 status = null
51682024-08-28T04:08:07.350ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51692024-08-28T04:08:07.351ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3b0729d1-fa3a-4c9a-843f-0f4075be91ef", "content-length": "691", "date": "Wed, 28 Aug 2024 04:08:06 GMT"} })
51702024-08-28T04:08:07.351ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
51712024-08-28T04:08:07.351ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
51722024-08-28T04:08:07.351ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
51732024-08-28T04:08:07.353ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 291.467492ms iteration = 6 status = {}
51742024-08-28T04:08:07.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51752024-08-28T04:08:07.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51762024-08-28T04:08:07.398ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 21872882-9c7e-4a12-8d80-3d3b1686a012, rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(726f0c10-a692-46cf-962b-4ac9a2a107fc) } rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
51772024-08-28T04:08:07.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51782024-08-28T04:08:07.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51792024-08-28T04:08:07.406ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
51802024-08-28T04:08:07.406ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e016e210-6fe1-4555-acf2-ca2a0c1cca33", "content-length": "121", "date": "Wed, 28 Aug 2024 04:08:06 GMT"} })
51812024-08-28T04:08:07.406ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
51822024-08-28T04:08:07.406ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 726f0c10-a692-46cf-962b-4ac9a2a107fc
51832024-08-28T04:08:07.406ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51842024-08-28T04:08:07.406ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51852024-08-28T04:08:07.406ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
51862024-08-28T04:08:07.406ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
51872024-08-28T04:08:07.406ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
51882024-08-28T04:08:07.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51892024-08-28T04:08:07.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51902024-08-28T04:08:07.408ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51912024-08-28T04:08:07.408ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c1f6c395-b925-490c-ad88-273cf2e63033", "content-length": "2", "date": "Wed, 28 Aug 2024 04:08:06 GMT"} })
51922024-08-28T04:08:07.408ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51932024-08-28T04:08:07.408ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a58d4708-4ca9-4daf-ac8f-7d8268c9ecde", "content-length": "50", "date": "Wed, 28 Aug 2024 04:08:06 GMT"} })
51942024-08-28T04:08:07.408ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
51952024-08-28T04:08:07.408ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51962024-08-28T04:08:07.507ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8cce1131-ddb3-40d6-8826-b3b9673189a7", "date": "Wed, 28 Aug 2024 04:08:06 GMT"} })
51972024-08-28T04:08:07.507ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch = Switch0
51982024-08-28T04:08:07.507ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51992024-08-28T04:08:07.597ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "44bfb029-f6ea-4892-8f15-c512ced5d665", "content-length": "667", "date": "Wed, 28 Aug 2024 04:08:07 GMT"} })
52002024-08-28T04:08:07.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52012024-08-28T04:08:07.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52022024-08-28T04:08:07.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52032024-08-28T04:08:07.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52042024-08-28T04:08:07.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52052024-08-28T04:08:07.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52062024-08-28T04:08:07.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52072024-08-28T04:08:07.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52082024-08-28T04:08:07.613ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 551.488059ms iteration = 6 status = {}
52092024-08-28T04:08:08.980ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:63480
52102024-08-28T04:08:08.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63480 req_id = 3ea870e0-fdaa-443c-90d8-4f5172182a4a roles = RoleSet { roles: {} } uri = /metrics/producers
52112024-08-28T04:08:08.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63480 req_id = 3ea870e0-fdaa-443c-90d8-4f5172182a4a resource = Database result = Ok(()) uri = /metrics/producers
52122024-08-28T04:08:09.013ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
52132024-08-28T04:08:09.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63480 req_id = 3ea870e0-fdaa-443c-90d8-4f5172182a4a roles = RoleSet { roles: {} } uri = /metrics/producers
52142024-08-28T04:08:09.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63480 req_id = 3ea870e0-fdaa-443c-90d8-4f5172182a4a resource = Database result = Ok(()) uri = /metrics/producers
52152024-08-28T04:08:09.020ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
52162024-08-28T04:08:09.020ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "40140a63-1a92-41aa-a063-bfa045de86bd", "date": "Wed, 28 Aug 2024 04:08:09 GMT"} })
52172024-08-28T04:08:09.020ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 84f8f69b-1de3-4c63-8327-f221abc8d62f
52182024-08-28T04:08:09.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40776 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63480 req_id = 3ea870e0-fdaa-443c-90d8-4f5172182a4a response_code = 201 uri = /metrics/producers
52192024-08-28T04:08:11.109ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1826 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 929febac-8758-4dfa-9880-e5243316ff26 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
52202024-08-28T04:08:17.061ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
52212024-08-28T04:08:17.061ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
52222024-08-28T04:08:17.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52232024-08-28T04:08:17.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52242024-08-28T04:08:17.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52252024-08-28T04:08:17.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52262024-08-28T04:08:17.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52272024-08-28T04:08:17.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52282024-08-28T04:08:17.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52292024-08-28T04:08:17.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52302024-08-28T04:08:17.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52312024-08-28T04:08:17.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.604696ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52322024-08-28T04:08:17.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52332024-08-28T04:08:17.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52342024-08-28T04:08:17.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52352024-08-28T04:08:17.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52362024-08-28T04:08:17.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
52372024-08-28T04:08:17.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52382024-08-28T04:08:17.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52392024-08-28T04:08:17.077ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
52402024-08-28T04:08:17.077ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.234737ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
52412024-08-28T04:08:21.077ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
52422024-08-28T04:08:21.077ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
52432024-08-28T04:08:21.108ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
52442024-08-28T04:08:21.108ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:60516
52452024-08-28T04:08:21.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60516 req_id = ba3d5511-db2f-4746-aaa8-eadac67e55db roles = RoleSet { roles: {} } uri = /metrics/producers
52462024-08-28T04:08:21.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60516 req_id = ba3d5511-db2f-4746-aaa8-eadac67e55db resource = Database result = Ok(()) uri = /metrics/producers
52472024-08-28T04:08:21.109ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1156 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = da2cb5ca-1879-4423-b919-2141c736b3f9 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
52482024-08-28T04:08:21.141ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
52492024-08-28T04:08:21.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60516 req_id = ba3d5511-db2f-4746-aaa8-eadac67e55db roles = RoleSet { roles: {} } uri = /metrics/producers
52502024-08-28T04:08:21.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60516 req_id = ba3d5511-db2f-4746-aaa8-eadac67e55db resource = Database result = Ok(()) uri = /metrics/producers
52512024-08-28T04:08:21.170ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
52522024-08-28T04:08:21.171ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "35dcd48c-e9a8-4371-b797-06e90c5e1f5c", "date": "Wed, 28 Aug 2024 04:08:21 GMT"} })
52532024-08-28T04:08:21.171ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
52542024-08-28T04:08:21.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 63850 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60516 req_id = ba3d5511-db2f-4746-aaa8-eadac67e55db response_code = 201 uri = /metrics/producers
52552024-08-28T04:08:21.172ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "ba3d5511-db2f-4746-aaa8-eadac67e55db", "content-length": "41", "date": "Wed, 28 Aug 2024 04:08:21 GMT"} })
52562024-08-28T04:08:21.173ZDEBGnexus (producer-registration-task): registered with nexus successfully
52572024-08-28T04:08:21.173ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
52582024-08-28T04:08:27.061ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
52592024-08-28T04:08:27.061ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
52602024-08-28T04:08:27.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52612024-08-28T04:08:27.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52622024-08-28T04:08:27.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52632024-08-28T04:08:27.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52642024-08-28T04:08:27.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52652024-08-28T04:08:27.063ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52662024-08-28T04:08:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52672024-08-28T04:08:27.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52682024-08-28T04:08:27.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52692024-08-28T04:08:27.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52702024-08-28T04:08:27.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52712024-08-28T04:08:27.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52722024-08-28T04:08:27.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52732024-08-28T04:08:27.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
52742024-08-28T04:08:27.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52752024-08-28T04:08:27.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52762024-08-28T04:08:27.078ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
52772024-08-28T04:08:27.078ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.438342ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
52782024-08-28T04:08:27.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.624012ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52792024-08-28T04:08:31.174ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1682 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 487bf83b-6e98-418b-b117-d1ef3f7d00ca response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
52802024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
52812024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
52822024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
52832024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52842024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52852024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
52862024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
52872024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52882024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
52892024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52902024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52912024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
52922024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
52932024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
52942024-08-28T04:08:37.061ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 03:58:37.061683494 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
52952024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
52962024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
52972024-08-28T04:08:37.061ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
52982024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
52992024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
53002024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53012024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
53022024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
53032024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53042024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53052024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
53062024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
53072024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
53082024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53092024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
53102024-08-28T04:08:37.061ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
53112024-08-28T04:08:37.061ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764
53122024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.14\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764"}
53132024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
53142024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
53152024-08-28T04:08:37.062ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
53162024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
53172024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53182024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53192024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53202024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
53212024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
53222024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53232024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53242024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
53252024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53262024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
53272024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
53282024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
53292024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53302024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
53312024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
53322024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53332024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53342024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
53352024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
53362024-08-28T04:08:37.062ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
53372024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53382024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53392024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
53402024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53412024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53422024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53432024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53442024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53452024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
53462024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53472024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53482024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53492024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53502024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53512024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
53522024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53532024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53542024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53552024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53562024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53572024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53582024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
53592024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53602024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53612024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53622024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53632024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53642024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53652024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53662024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53672024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53682024-08-28T04:08:37.062ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53692024-08-28T04:08:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53702024-08-28T04:08:37.063ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53712024-08-28T04:08:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53722024-08-28T04:08:37.064ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4eb364e4-14a2-46c4-b173-eb2890920e8f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 147073633 } })
53732024-08-28T04:08:37.064ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("037b07ce-9e39-4982-8c20-c4c38f448b97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4e2ba65e-422a-4b1e-b0e3-85f8149a979a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 147119864 } })
53742024-08-28T04:08:37.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53752024-08-28T04:08:37.065ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53762024-08-28T04:08:37.067ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
53772024-08-28T04:08:37.067ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 5.468981ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
53782024-08-28T04:08:37.067ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
53792024-08-28T04:08:37.067ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.41875ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
53802024-08-28T04:08:37.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53812024-08-28T04:08:37.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53822024-08-28T04:08:37.069ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53832024-08-28T04:08:37.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53842024-08-28T04:08:37.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53852024-08-28T04:08:37.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53862024-08-28T04:08:37.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53872024-08-28T04:08:37.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53882024-08-28T04:08:37.070ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.531861ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53892024-08-28T04:08:37.071ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53902024-08-28T04:08:37.072ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 03:58:37.061683494 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
53912024-08-28T04:08:37.072ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.366245ms iteration = 4 status = {"expiration":"2024-08-28T03:58:37.061683494Z","pruned":[]}
53922024-08-28T04:08:37.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53932024-08-28T04:08:37.073ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53942024-08-28T04:08:37.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53952024-08-28T04:08:37.079ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53962024-08-28T04:08:37.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53972024-08-28T04:08:37.081ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53982024-08-28T04:08:37.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53992024-08-28T04:08:37.082ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54002024-08-28T04:08:37.083ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
54012024-08-28T04:08:37.083ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
54022024-08-28T04:08:37.083ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 21.900613ms iteration = 4 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
54032024-08-28T04:08:37.084ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54042024-08-28T04:08:37.084ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54052024-08-28T04:08:37.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54062024-08-28T04:08:37.092ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 30.130435ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
54072024-08-28T04:08:37.093ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 175929881 } })
54082024-08-28T04:08:37.093ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
54092024-08-28T04:08:37.095ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54102024-08-28T04:08:37.095ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54112024-08-28T04:08:37.097ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54122024-08-28T04:08:37.098ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 180941838 } })
54132024-08-28T04:08:37.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54142024-08-28T04:08:37.099ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54152024-08-28T04:08:37.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54162024-08-28T04:08:37.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
54172024-08-28T04:08:37.099ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54182024-08-28T04:08:37.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54192024-08-28T04:08:37.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54202024-08-28T04:08:37.100ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54212024-08-28T04:08:37.100ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
54222024-08-28T04:08:37.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54232024-08-28T04:08:37.100ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54242024-08-28T04:08:37.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54252024-08-28T04:08:37.102ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54262024-08-28T04:08:37.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54272024-08-28T04:08:37.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54282024-08-28T04:08:37.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54292024-08-28T04:08:37.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54302024-08-28T04:08:37.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54312024-08-28T04:08:37.112ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
54322024-08-28T04:08:37.112ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
54332024-08-28T04:08:37.112ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
54342024-08-28T04:08:37.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54352024-08-28T04:08:37.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54362024-08-28T04:08:37.112ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54372024-08-28T04:08:37.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54382024-08-28T04:08:37.113ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54392024-08-28T04:08:37.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54402024-08-28T04:08:37.132ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54412024-08-28T04:08:37.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54422024-08-28T04:08:37.135ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54432024-08-28T04:08:37.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54442024-08-28T04:08:37.137ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54452024-08-28T04:08:37.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
54462024-08-28T04:08:37.137ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54472024-08-28T04:08:37.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54482024-08-28T04:08:37.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54492024-08-28T04:08:37.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54502024-08-28T04:08:37.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54512024-08-28T04:08:37.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54522024-08-28T04:08:37.140ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54532024-08-28T04:08:37.141ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54542024-08-28T04:08:37.141ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54552024-08-28T04:08:37.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54562024-08-28T04:08:37.143ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
54572024-08-28T04:08:37.143ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54582024-08-28T04:08:37.143ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54592024-08-28T04:08:37.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54602024-08-28T04:08:37.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54612024-08-28T04:08:37.144ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54622024-08-28T04:08:37.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54632024-08-28T04:08:37.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54642024-08-28T04:08:37.145ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54652024-08-28T04:08:37.146ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54662024-08-28T04:08:37.146ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54672024-08-28T04:08:37.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54682024-08-28T04:08:37.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54692024-08-28T04:08:37.147ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54702024-08-28T04:08:37.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54712024-08-28T04:08:37.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54722024-08-28T04:08:37.148ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54732024-08-28T04:08:37.148ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54742024-08-28T04:08:37.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 86.899852ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
54752024-08-28T04:08:37.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54762024-08-28T04:08:37.148ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54772024-08-28T04:08:37.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54782024-08-28T04:08:37.149ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54792024-08-28T04:08:37.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54802024-08-28T04:08:37.150ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
54812024-08-28T04:08:37.150ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54822024-08-28T04:08:37.150ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 88.705955ms iteration = 7 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
54832024-08-28T04:08:37.151ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54842024-08-28T04:08:37.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54852024-08-28T04:08:37.151ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54862024-08-28T04:08:37.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54872024-08-28T04:08:37.152ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54882024-08-28T04:08:37.154ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54892024-08-28T04:08:37.154ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 236930822 } })
54902024-08-28T04:08:37.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54912024-08-28T04:08:37.154ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
54922024-08-28T04:08:37.154ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.197027ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
54932024-08-28T04:08:37.155ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54942024-08-28T04:08:37.155ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54952024-08-28T04:08:37.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54962024-08-28T04:08:37.155ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54972024-08-28T04:08:37.155ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54982024-08-28T04:08:37.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54992024-08-28T04:08:37.156ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
55002024-08-28T04:08:37.157ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55012024-08-28T04:08:37.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55022024-08-28T04:08:37.159ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55032024-08-28T04:08:37.160ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55042024-08-28T04:08:37.161ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55052024-08-28T04:08:37.161ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55062024-08-28T04:08:37.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55072024-08-28T04:08:37.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55082024-08-28T04:08:37.164ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55092024-08-28T04:08:37.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55102024-08-28T04:08:37.164ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55112024-08-28T04:08:37.165ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 104.255952ms iteration = 3 status = {"nsuccess":5}
55122024-08-28T04:08:37.166ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55132024-08-28T04:08:37.166ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55142024-08-28T04:08:37.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55152024-08-28T04:08:37.171ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
55162024-08-28T04:08:37.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55172024-08-28T04:08:37.175ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 113.666599ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55182024-08-28T04:08:37.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55192024-08-28T04:08:37.180ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
55202024-08-28T04:08:37.180ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
55212024-08-28T04:08:37.180ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 118.418608ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
55222024-08-28T04:08:37.187ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55232024-08-28T04:08:37.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55242024-08-28T04:08:37.189ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 127.729182ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
55252024-08-28T04:08:37.192ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
55262024-08-28T04:08:37.192ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 0 version = 2
55272024-08-28T04:08:37.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55282024-08-28T04:08:37.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55292024-08-28T04:08:37.194ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55302024-08-28T04:08:37.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55312024-08-28T04:08:37.199ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 137.20945ms iteration = 7 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
55322024-08-28T04:08:37.200ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 138.776886ms iteration = 9 status = {"physical_disks_added":0}
55332024-08-28T04:08:37.201ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
55342024-08-28T04:08:37.201ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 139.773555ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55352024-08-28T04:08:37.203ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
55362024-08-28T04:08:37.224ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
55372024-08-28T04:08:37.224ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
55382024-08-28T04:08:37.224ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
55392024-08-28T04:08:37.224ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55402024-08-28T04:08:37.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55412024-08-28T04:08:37.230ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55422024-08-28T04:08:37.230ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 168.375646ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55432024-08-28T04:08:37.242ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
55442024-08-28T04:08:37.242ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55452024-08-28T04:08:37.242ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aa2f6488-28fb-430f-9233-e01459dc38c8", "content-length": "26", "date": "Wed, 28 Aug 2024 04:08:36 GMT"} })
55462024-08-28T04:08:37.242ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55472024-08-28T04:08:37.244ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55482024-08-28T04:08:37.301ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
55492024-08-28T04:08:37.301ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55502024-08-28T04:08:37.302ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "33f8a2e1-640e-429c-9acd-529cc1f076d7", "content-length": "26", "date": "Wed, 28 Aug 2024 04:08:36 GMT"} })
55512024-08-28T04:08:37.302ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55522024-08-28T04:08:37.304ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55532024-08-28T04:08:37.381ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55542024-08-28T04:08:37.381ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fa6378dc-f914-4f71-8496-8885b7ff2aba", "content-length": "691", "date": "Wed, 28 Aug 2024 04:08:37 GMT"} })
55552024-08-28T04:08:37.381ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
55562024-08-28T04:08:37.381ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
55572024-08-28T04:08:37.381ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
55582024-08-28T04:08:37.383ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 321.657578ms iteration = 7 status = {}
55592024-08-28T04:08:37.383ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55602024-08-28T04:08:37.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55612024-08-28T04:08:37.401ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 zone_address = fd00:1122:3344:101::2
55622024-08-28T04:08:37.401ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55632024-08-28T04:08:37.401ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f9a1bdf0-a054-45d4-8ad8-6cc3e1dd7bb0", "content-length": "26", "date": "Wed, 28 Aug 2024 04:08:36 GMT"} })
55642024-08-28T04:08:37.401ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55652024-08-28T04:08:37.403ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
55662024-08-28T04:08:37.417ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
55672024-08-28T04:08:37.418ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
55682024-08-28T04:08:37.419ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4ad9ff02-f1d8-422b-b115-1e5519508eeb", "date": "Wed, 28 Aug 2024 04:08:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55692024-08-28T04:08:37.419ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55702024-08-28T04:08:37.420ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6bdcb3a8-eaac-4abd-b7e8-c1202099245d", "date": "Wed, 28 Aug 2024 04:08:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55712024-08-28T04:08:37.420ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55722024-08-28T04:08:37.422ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55732024-08-28T04:08:37.422ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 360.435187ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
55742024-08-28T04:08:37.457ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55752024-08-28T04:08:37.457ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5c1bd62b-d9c6-47c9-8a70-0b330ecb0031", "content-length": "372", "date": "Wed, 28 Aug 2024 04:08:37 GMT"} })
55762024-08-28T04:08:37.457ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55772024-08-28T04:08:37.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55782024-08-28T04:08:37.460ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55792024-08-28T04:08:37.460ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55802024-08-28T04:08:37.460ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55812024-08-28T04:08:37.460ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55822024-08-28T04:08:37.463ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55832024-08-28T04:08:37.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55842024-08-28T04:08:37.463ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55852024-08-28T04:08:37.463ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55862024-08-28T04:08:37.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55872024-08-28T04:08:37.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55882024-08-28T04:08:37.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55892024-08-28T04:08:37.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55902024-08-28T04:08:37.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
55912024-08-28T04:08:37.465ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55922024-08-28T04:08:37.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55932024-08-28T04:08:37.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55942024-08-28T04:08:37.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55952024-08-28T04:08:37.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55962024-08-28T04:08:37.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55972024-08-28T04:08:37.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55982024-08-28T04:08:37.468ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 406.298235ms iteration = 7 status = 0
55992024-08-28T04:08:37.468ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 1 version = 2
56002024-08-28T04:08:37.468ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
56012024-08-28T04:08:37.468ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 04:05:50.133665 UTC dns_group = external generation = 2
56022024-08-28T04:08:37.468ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 407.305274ms iteration = 5 status = {"generation":2}
56032024-08-28T04:08:37.471ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56042024-08-28T04:08:37.473ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d24e96dc-f99d-43b6-99c0-2a11b33e84dd", "date": "Wed, 28 Aug 2024 04:08:37 GMT"} })
56052024-08-28T04:08:37.475ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 413.399083ms iteration = 8 status = {}
56062024-08-28T04:08:37.487ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
56072024-08-28T04:08:37.487ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "16025ded-7c85-476e-95de-6fa124b739e1", "content-length": "1", "date": "Wed, 28 Aug 2024 04:08:37 GMT"} })
56082024-08-28T04:08:37.490ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56092024-08-28T04:08:37.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56102024-08-28T04:08:37.492ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 430.169945ms iteration = 7 status = null
56112024-08-28T04:08:37.502ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 440.424047ms iteration = 7 status = {}
56122024-08-28T04:08:37.503ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
56132024-08-28T04:08:37.503ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
56142024-08-28T04:08:37.503ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56152024-08-28T04:08:37.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56162024-08-28T04:08:37.507ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T04:05:35.065116Z, time_modified: 2024-08-28T04:05:35.065116Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }) }
56172024-08-28T04:08:37.507ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 446.093523ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]}},"default_endpoint":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
56182024-08-28T04:08:37.514ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
56192024-08-28T04:08:37.514ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f85b8117-3d9f-45e5-9776-6d9bd35fda1e", "date": "Wed, 28 Aug 2024 04:08:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56202024-08-28T04:08:37.514ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56212024-08-28T04:08:37.516ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "95e542f9-622a-4a84-bebc-25bd3d1ee516", "date": "Wed, 28 Aug 2024 04:08:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56222024-08-28T04:08:37.516ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56232024-08-28T04:08:37.517ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "344bec4c-e6bd-46f2-a615-9e3785973d7a", "date": "Wed, 28 Aug 2024 04:08:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56242024-08-28T04:08:37.517ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56252024-08-28T04:08:37.518ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56262024-08-28T04:08:37.518ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 457.178119ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
56272024-08-28T04:08:37.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56282024-08-28T04:08:37.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56292024-08-28T04:08:37.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56302024-08-28T04:08:37.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56312024-08-28T04:08:37.536ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
56322024-08-28T04:08:37.536ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
56332024-08-28T04:08:37.536ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 04:05:49.286960 UTC dns_group = internal generation = 1
56342024-08-28T04:08:37.536ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 474.763435ms iteration = 5 status = {"generation":1}
56352024-08-28T04:08:37.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56362024-08-28T04:08:37.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56372024-08-28T04:08:37.583ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 21872882-9c7e-4a12-8d80-3d3b1686a012, rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(726f0c10-a692-46cf-962b-4ac9a2a107fc) } rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
56382024-08-28T04:08:37.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56392024-08-28T04:08:37.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56402024-08-28T04:08:37.593ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56412024-08-28T04:08:37.593ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c126f079-f9d9-4b06-846d-aba93b11aa57", "content-length": "121", "date": "Wed, 28 Aug 2024 04:08:37 GMT"} })
56422024-08-28T04:08:37.593ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
56432024-08-28T04:08:37.593ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 726f0c10-a692-46cf-962b-4ac9a2a107fc
56442024-08-28T04:08:37.594ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56452024-08-28T04:08:37.594ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56462024-08-28T04:08:37.594ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
56472024-08-28T04:08:37.594ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
56482024-08-28T04:08:37.594ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
56492024-08-28T04:08:37.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56502024-08-28T04:08:37.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56512024-08-28T04:08:37.596ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56522024-08-28T04:08:37.596ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2951a01f-3dca-40dd-be6f-8876417ce79b", "content-length": "2", "date": "Wed, 28 Aug 2024 04:08:37 GMT"} })
56532024-08-28T04:08:37.596ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56542024-08-28T04:08:37.596ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "372f9f01-528d-4682-8a46-6bdbf560d0c0", "content-length": "50", "date": "Wed, 28 Aug 2024 04:08:37 GMT"} })
56552024-08-28T04:08:37.596ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
56562024-08-28T04:08:37.596ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56572024-08-28T04:08:37.698ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c0877258-1d44-4a9a-9b71-b50c1a3b9a78", "date": "Wed, 28 Aug 2024 04:08:37 GMT"} })
56582024-08-28T04:08:37.698ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch = Switch0
56592024-08-28T04:08:37.698ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56602024-08-28T04:08:37.702ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "caafc45a-5c6f-4a5e-b6e8-39062736a940", "content-length": "667", "date": "Wed, 28 Aug 2024 04:08:37 GMT"} })
56612024-08-28T04:08:37.702ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56622024-08-28T04:08:37.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56632024-08-28T04:08:37.706ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56642024-08-28T04:08:37.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56652024-08-28T04:08:37.710ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56662024-08-28T04:08:37.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56672024-08-28T04:08:37.712ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56682024-08-28T04:08:37.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56692024-08-28T04:08:37.719ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 657.471062ms iteration = 7 status = {}
56702024-08-28T04:08:41.174ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1732 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = b044490b-3021-4eb1-8d8d-2822e75d2fe6 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
56712024-08-28T04:08:47.061ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
56722024-08-28T04:08:47.061ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
56732024-08-28T04:08:47.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56742024-08-28T04:08:47.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56752024-08-28T04:08:47.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56762024-08-28T04:08:47.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56772024-08-28T04:08:47.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56782024-08-28T04:08:47.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56792024-08-28T04:08:47.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56802024-08-28T04:08:47.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56812024-08-28T04:08:47.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56822024-08-28T04:08:47.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56832024-08-28T04:08:47.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56842024-08-28T04:08:47.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
56852024-08-28T04:08:47.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56862024-08-28T04:08:47.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56872024-08-28T04:08:47.084ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
56882024-08-28T04:08:47.084ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.269964ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
56892024-08-28T04:08:47.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56902024-08-28T04:08:47.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56912024-08-28T04:08:47.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.18373ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56922024-08-28T04:08:51.173ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 9b4fb3a5-b77a-47c7-ab8d-263fe3cc1f0a response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
56932024-08-28T04:08:52.322ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:32897
56942024-08-28T04:08:52.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32897 req_id = bf2ac62b-03a5-436a-a82c-c4b55d6225cd roles = RoleSet { roles: {} } uri = /metrics/producers
56952024-08-28T04:08:52.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32897 req_id = bf2ac62b-03a5-436a-a82c-c4b55d6225cd resource = Database result = Ok(()) uri = /metrics/producers
56962024-08-28T04:08:52.355ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
56972024-08-28T04:08:52.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32897 req_id = bf2ac62b-03a5-436a-a82c-c4b55d6225cd roles = RoleSet { roles: {} } uri = /metrics/producers
56982024-08-28T04:08:52.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32897 req_id = bf2ac62b-03a5-436a-a82c-c4b55d6225cd resource = Database result = Ok(()) uri = /metrics/producers
56992024-08-28T04:08:52.384ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
57002024-08-28T04:08:52.385ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0508a1b7-9a65-4750-866f-881469add709", "date": "Wed, 28 Aug 2024 04:08:52 GMT"} })
57012024-08-28T04:08:52.385ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 3cb8c6a9-56d6-4181-bb25-feecc98b4c4e
57022024-08-28T04:08:52.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 64191 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32897 req_id = bf2ac62b-03a5-436a-a82c-c4b55d6225cd response_code = 201 uri = /metrics/producers
57032024-08-28T04:08:57.061ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
57042024-08-28T04:08:57.061ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
57052024-08-28T04:08:57.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57062024-08-28T04:08:57.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57072024-08-28T04:08:57.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57082024-08-28T04:08:57.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57092024-08-28T04:08:57.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57102024-08-28T04:08:57.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57112024-08-28T04:08:57.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57122024-08-28T04:08:57.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57132024-08-28T04:08:57.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57142024-08-28T04:08:57.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57152024-08-28T04:08:57.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57162024-08-28T04:08:57.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
57172024-08-28T04:08:57.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57182024-08-28T04:08:57.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57192024-08-28T04:08:57.081ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
57202024-08-28T04:08:57.081ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.046198ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
57212024-08-28T04:08:57.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57222024-08-28T04:08:57.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57232024-08-28T04:08:57.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.198689ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57242024-08-28T04:09:01.173ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1414 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = f5bdeb01-5982-41d7-bf28-940d5900ecaf response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
57252024-08-28T04:09:07.060ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
57262024-08-28T04:09:07.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57272024-08-28T04:09:07.060ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
57282024-08-28T04:09:07.060ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57292024-08-28T04:09:07.060ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
57302024-08-28T04:09:07.060ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
57312024-08-28T04:09:07.060ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57322024-08-28T04:09:07.060ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
57332024-08-28T04:09:07.060ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
57342024-08-28T04:09:07.060ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57352024-08-28T04:09:07.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57362024-08-28T04:09:07.060ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
57372024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57382024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
57392024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
57402024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57412024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57422024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
57432024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
57442024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57452024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57462024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
57472024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57482024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
57492024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57502024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
57512024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
57522024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57532024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
57542024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57552024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
57562024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57572024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57582024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57592024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57602024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57612024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57622024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57632024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57642024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57652024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57662024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57672024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57682024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57692024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57702024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57712024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57722024-08-28T04:09:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57732024-08-28T04:09:07.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57742024-08-28T04:09:07.065ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.352187ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57752024-08-28T04:09:07.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57762024-08-28T04:09:07.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57772024-08-28T04:09:07.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57782024-08-28T04:09:07.070ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1234, tv_nsec: 153168982 } })
57792024-08-28T04:09:07.071ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
57802024-08-28T04:09:07.089ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1234, tv_nsec: 172434448 } })
57812024-08-28T04:09:07.089ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
57822024-08-28T04:09:07.091ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1234, tv_nsec: 174807308 } })
57832024-08-28T04:09:07.092ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
57842024-08-28T04:09:07.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57852024-08-28T04:09:07.109ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.062251ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
57862024-08-28T04:09:07.111ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57872024-08-28T04:09:07.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57882024-08-28T04:09:07.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57892024-08-28T04:09:07.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57902024-08-28T04:09:07.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57912024-08-28T04:09:07.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57922024-08-28T04:09:07.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57932024-08-28T04:09:07.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57942024-08-28T04:09:07.121ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57952024-08-28T04:09:07.122ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57962024-08-28T04:09:07.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57972024-08-28T04:09:07.123ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57982024-08-28T04:09:07.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57992024-08-28T04:09:07.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58002024-08-28T04:09:07.123ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58012024-08-28T04:09:07.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58022024-08-28T04:09:07.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58032024-08-28T04:09:07.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58042024-08-28T04:09:07.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58052024-08-28T04:09:07.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58062024-08-28T04:09:07.126ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58072024-08-28T04:09:07.126ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58082024-08-28T04:09:07.126ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.70881ms iteration = 8 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
58092024-08-28T04:09:07.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58102024-08-28T04:09:07.127ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58112024-08-28T04:09:07.127ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58122024-08-28T04:09:07.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58132024-08-28T04:09:07.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58142024-08-28T04:09:07.128ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58152024-08-28T04:09:07.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58162024-08-28T04:09:07.129ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58172024-08-28T04:09:07.129ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
58182024-08-28T04:09:07.129ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58192024-08-28T04:09:07.129ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58202024-08-28T04:09:07.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58212024-08-28T04:09:07.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58222024-08-28T04:09:07.135ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58232024-08-28T04:09:07.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58242024-08-28T04:09:07.136ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58252024-08-28T04:09:07.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58262024-08-28T04:09:07.139ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58272024-08-28T04:09:07.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58282024-08-28T04:09:07.152ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 91.639471ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58292024-08-28T04:09:07.155ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58302024-08-28T04:09:07.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58312024-08-28T04:09:07.160ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
58322024-08-28T04:09:07.160ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58332024-08-28T04:09:07.161ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "85e521fd-ba3d-4744-b66a-499c02af1a0c", "content-length": "26", "date": "Wed, 28 Aug 2024 04:09:07 GMT"} })
58342024-08-28T04:09:07.161ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58352024-08-28T04:09:07.161ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58362024-08-28T04:09:07.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58372024-08-28T04:09:07.162ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58382024-08-28T04:09:07.163ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58392024-08-28T04:09:07.166ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
58402024-08-28T04:09:07.166ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58412024-08-28T04:09:07.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58422024-08-28T04:09:07.168ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 107.930141ms iteration = 8 status = 0
58432024-08-28T04:09:07.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58442024-08-28T04:09:07.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
58452024-08-28T04:09:07.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58462024-08-28T04:09:07.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58472024-08-28T04:09:07.172ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58482024-08-28T04:09:07.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58492024-08-28T04:09:07.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 111.700441ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
58502024-08-28T04:09:07.174ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
58512024-08-28T04:09:07.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 113.658248ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
58522024-08-28T04:09:07.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58532024-08-28T04:09:07.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58542024-08-28T04:09:07.177ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58552024-08-28T04:09:07.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58562024-08-28T04:09:07.177ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
58572024-08-28T04:09:07.177ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58582024-08-28T04:09:07.177ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 116.644766ms iteration = 8 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
58592024-08-28T04:09:07.180ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
58602024-08-28T04:09:07.180ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 119.900282ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
58612024-08-28T04:09:07.211ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58622024-08-28T04:09:07.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58632024-08-28T04:09:07.215ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58642024-08-28T04:09:07.215ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 153.915791ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58652024-08-28T04:09:07.267ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 206.341341ms iteration = 10 status = {"physical_disks_added":0}
58662024-08-28T04:09:07.294ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
58672024-08-28T04:09:07.294ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58682024-08-28T04:09:07.295ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1dbb5f45-7c12-49d6-b01e-9ac3ab5dfb95", "content-length": "26", "date": "Wed, 28 Aug 2024 04:09:07 GMT"} })
58692024-08-28T04:09:07.295ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58702024-08-28T04:09:07.296ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58712024-08-28T04:09:07.299ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58722024-08-28T04:09:07.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58732024-08-28T04:09:07.303ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 zone_address = fd00:1122:3344:101::2
58742024-08-28T04:09:07.303ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58752024-08-28T04:09:07.303ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4c82865a-f0d4-4ce2-be08-7e74ca2df8cf", "content-length": "26", "date": "Wed, 28 Aug 2024 04:09:07 GMT"} })
58762024-08-28T04:09:07.303ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58772024-08-28T04:09:07.305ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
58782024-08-28T04:09:07.323ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
58792024-08-28T04:09:07.325ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "724d0a5b-0e4f-43df-ae2f-c926c89e7910", "content-length": "1", "date": "Wed, 28 Aug 2024 04:09:06 GMT"} })
58802024-08-28T04:09:07.326ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58812024-08-28T04:09:07.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58822024-08-28T04:09:07.334ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58832024-08-28T04:09:07.336ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58842024-08-28T04:09:07.337ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58852024-08-28T04:09:07.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58862024-08-28T04:09:07.358ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58872024-08-28T04:09:07.358ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "eede5a34-38fd-4ce7-af8d-7617f81bc23a", "content-length": "372", "date": "Wed, 28 Aug 2024 04:09:06 GMT"} })
58882024-08-28T04:09:07.359ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58892024-08-28T04:09:07.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58902024-08-28T04:09:07.360ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58912024-08-28T04:09:07.360ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 299.800206ms iteration = 8 status = null
58922024-08-28T04:09:07.361ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58932024-08-28T04:09:07.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58942024-08-28T04:09:07.362ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58952024-08-28T04:09:07.362ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58962024-08-28T04:09:07.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58972024-08-28T04:09:07.364ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58982024-08-28T04:09:07.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58992024-08-28T04:09:07.367ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59002024-08-28T04:09:07.367ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8cc18b94-5b50-4fc8-8266-63250cc14c8d", "date": "Wed, 28 Aug 2024 04:09:06 GMT"} })
59012024-08-28T04:09:07.369ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 308.179682ms iteration = 9 status = {}
59022024-08-28T04:09:07.390ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 329.149338ms iteration = 8 status = {}
59032024-08-28T04:09:07.435ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59042024-08-28T04:09:07.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59052024-08-28T04:09:07.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59062024-08-28T04:09:07.482ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 21872882-9c7e-4a12-8d80-3d3b1686a012, rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(726f0c10-a692-46cf-962b-4ac9a2a107fc) } rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
59072024-08-28T04:09:07.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59082024-08-28T04:09:07.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59092024-08-28T04:09:07.492ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
59102024-08-28T04:09:07.492ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0022507d-ba40-4f33-a77a-7e55f5680a55", "content-length": "121", "date": "Wed, 28 Aug 2024 04:09:07 GMT"} })
59112024-08-28T04:09:07.492ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
59122024-08-28T04:09:07.492ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 726f0c10-a692-46cf-962b-4ac9a2a107fc
59132024-08-28T04:09:07.493ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59142024-08-28T04:09:07.493ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59152024-08-28T04:09:07.493ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
59162024-08-28T04:09:07.493ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
59172024-08-28T04:09:07.493ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
59182024-08-28T04:09:07.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59192024-08-28T04:09:07.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59202024-08-28T04:09:07.495ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
59212024-08-28T04:09:07.495ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bb6b47f9-0961-4c34-8d72-bb8a066c0846", "content-length": "2", "date": "Wed, 28 Aug 2024 04:09:07 GMT"} })
59222024-08-28T04:09:07.495ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
59232024-08-28T04:09:07.495ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6e09de48-a050-4fc6-8cc8-42a4eb01ea0c", "content-length": "50", "date": "Wed, 28 Aug 2024 04:09:07 GMT"} })
59242024-08-28T04:09:07.495ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
59252024-08-28T04:09:07.495ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
59262024-08-28T04:09:07.504ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1e64bb66-ce71-4080-8d47-0806ab052897", "content-length": "691", "date": "Wed, 28 Aug 2024 04:09:07 GMT"} })
59272024-08-28T04:09:07.504ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
59282024-08-28T04:09:07.504ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
59292024-08-28T04:09:07.504ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
59302024-08-28T04:09:07.506ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 445.667581ms iteration = 8 status = {}
59312024-08-28T04:09:07.605ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cf082de0-f680-4097-b668-e5678d9c282c", "date": "Wed, 28 Aug 2024 04:09:06 GMT"} })
59322024-08-28T04:09:07.605ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch = Switch0
59332024-08-28T04:09:07.605ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
59342024-08-28T04:09:07.606ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "092055c7-dce7-45a3-99fc-2751ae6279c7", "content-length": "667", "date": "Wed, 28 Aug 2024 04:09:07 GMT"} })
59352024-08-28T04:09:07.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59362024-08-28T04:09:07.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59372024-08-28T04:09:07.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59382024-08-28T04:09:07.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59392024-08-28T04:09:07.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59402024-08-28T04:09:07.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59412024-08-28T04:09:07.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59422024-08-28T04:09:07.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59432024-08-28T04:09:07.622ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 562.070801ms iteration = 8 status = {}
59442024-08-28T04:09:11.173ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1220 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 7fd18b2a-b9e1-4eac-8334-edfd2b3caf0e response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
59452024-08-28T04:09:15.672ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:60599
59462024-08-28T04:09:15.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60599 req_id = c3510131-17aa-42aa-b27e-49dd73d43859 roles = RoleSet { roles: {} } uri = /metrics/producers
59472024-08-28T04:09:15.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60599 req_id = c3510131-17aa-42aa-b27e-49dd73d43859 resource = Database result = Ok(()) uri = /metrics/producers
59482024-08-28T04:09:15.706ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
59492024-08-28T04:09:15.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60599 req_id = c3510131-17aa-42aa-b27e-49dd73d43859 roles = RoleSet { roles: {} } uri = /metrics/producers
59502024-08-28T04:09:15.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60599 req_id = c3510131-17aa-42aa-b27e-49dd73d43859 resource = Database result = Ok(()) uri = /metrics/producers
59512024-08-28T04:09:15.736ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
59522024-08-28T04:09:15.737ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a4aa5768-a388-4cc0-aae4-e1b7246bb1f5", "date": "Wed, 28 Aug 2024 04:09:15 GMT"} })
59532024-08-28T04:09:15.737ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = e29f29d2-885c-4b33-aca8-4c86de0266cb
59542024-08-28T04:09:15.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 65258 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60599 req_id = c3510131-17aa-42aa-b27e-49dd73d43859 response_code = 201 uri = /metrics/producers
59552024-08-28T04:09:17.060ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
59562024-08-28T04:09:17.060ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
59572024-08-28T04:09:17.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59582024-08-28T04:09:17.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59592024-08-28T04:09:17.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59602024-08-28T04:09:17.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59612024-08-28T04:09:17.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59622024-08-28T04:09:17.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59632024-08-28T04:09:17.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59642024-08-28T04:09:17.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59652024-08-28T04:09:17.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59662024-08-28T04:09:17.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59672024-08-28T04:09:17.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59682024-08-28T04:09:17.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
59692024-08-28T04:09:17.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59702024-08-28T04:09:17.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59712024-08-28T04:09:17.078ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
59722024-08-28T04:09:17.078ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.452403ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
59732024-08-28T04:09:17.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59742024-08-28T04:09:17.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59752024-08-28T04:09:17.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.817097ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59762024-08-28T04:09:21.173ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1187 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 23f027eb-0e57-4840-9965-df23a0427ac5 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
59772024-08-28T04:09:27.060ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
59782024-08-28T04:09:27.060ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
59792024-08-28T04:09:27.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59802024-08-28T04:09:27.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59812024-08-28T04:09:27.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59822024-08-28T04:09:27.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59832024-08-28T04:09:27.063ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59842024-08-28T04:09:27.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59852024-08-28T04:09:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59862024-08-28T04:09:27.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.272995ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59872024-08-28T04:09:27.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59882024-08-28T04:09:27.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59892024-08-28T04:09:27.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59902024-08-28T04:09:27.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59912024-08-28T04:09:27.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59922024-08-28T04:09:27.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59932024-08-28T04:09:27.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
59942024-08-28T04:09:27.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59952024-08-28T04:09:27.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59962024-08-28T04:09:27.080ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
59972024-08-28T04:09:27.080ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.07318ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
59982024-08-28T04:09:31.172ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1211 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 76edc7f6-f5ad-43de-b857-da79be1930d7 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
59992024-08-28T04:09:33.743ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:58881
60002024-08-28T04:09:33.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58881 req_id = 02372e3d-d88a-4792-a458-b035b1e7dbac roles = RoleSet { roles: {} } uri = /metrics/producers
60012024-08-28T04:09:33.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58881 req_id = 02372e3d-d88a-4792-a458-b035b1e7dbac resource = Database result = Ok(()) uri = /metrics/producers
60022024-08-28T04:09:33.776ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
60032024-08-28T04:09:33.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58881 req_id = 02372e3d-d88a-4792-a458-b035b1e7dbac roles = RoleSet { roles: {} } uri = /metrics/producers
60042024-08-28T04:09:33.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58881 req_id = 02372e3d-d88a-4792-a458-b035b1e7dbac resource = Database result = Ok(()) uri = /metrics/producers
60052024-08-28T04:09:33.805ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
60062024-08-28T04:09:33.805ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "70f086f6-c27a-4fd3-afa6-91fde505e3f0", "date": "Wed, 28 Aug 2024 04:09:33 GMT"} })
60072024-08-28T04:09:33.805ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 0e1d8d78-006e-4d11-afc1-f62f97ae2dc4
60082024-08-28T04:09:33.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 63939 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58881 req_id = 02372e3d-d88a-4792-a458-b035b1e7dbac response_code = 201 uri = /metrics/producers
60092024-08-28T04:09:37.060ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
60102024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60112024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
60122024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
60132024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60142024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
60152024-08-28T04:09:37.061ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
60162024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
60172024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
60182024-08-28T04:09:37.061ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
60192024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60202024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
60212024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60222024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
60232024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60242024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
60252024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
60262024-08-28T04:09:37.061ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764
60272024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
60282024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
60292024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.541\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764"}
60302024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
60312024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60322024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60332024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
60342024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
60352024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60362024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
60372024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60382024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
60392024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
60402024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60412024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
60422024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60432024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
60442024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60452024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
60462024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
60472024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60482024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
60492024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60502024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
60512024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
60522024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
60532024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
60542024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
60552024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
60562024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60572024-08-28T04:09:37.061ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
60582024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
60592024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
60602024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
60612024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
60622024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
60632024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
60642024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60652024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
60662024-08-28T04:09:37.061ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 03:59:37.061406995 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
60672024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
60682024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60692024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60702024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60712024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60722024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60732024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60742024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60752024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60762024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60772024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60782024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60792024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60802024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60812024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60822024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
60832024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60842024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
60852024-08-28T04:09:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
60862024-08-28T04:09:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
60872024-08-28T04:09:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60882024-08-28T04:09:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60892024-08-28T04:09:37.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
60902024-08-28T04:09:37.062ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("037b07ce-9e39-4982-8c20-c4c38f448b97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4e2ba65e-422a-4b1e-b0e3-85f8149a979a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 145358083 } })
60912024-08-28T04:09:37.062ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4eb364e4-14a2-46c4-b173-eb2890920e8f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 145359523 } })
60922024-08-28T04:09:37.063ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
60932024-08-28T04:09:37.063ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.619037ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
60942024-08-28T04:09:37.064ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60952024-08-28T04:09:37.065ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
60962024-08-28T04:09:37.065ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.448231ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
60972024-08-28T04:09:37.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60982024-08-28T04:09:37.066ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.211213ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60992024-08-28T04:09:37.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61002024-08-28T04:09:37.066ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61012024-08-28T04:09:37.067ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 150555455 } })
61022024-08-28T04:09:37.067ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61032024-08-28T04:09:37.067ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61042024-08-28T04:09:37.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61052024-08-28T04:09:37.067ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
61062024-08-28T04:09:37.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
61072024-08-28T04:09:37.069ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61082024-08-28T04:09:37.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61092024-08-28T04:09:37.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61102024-08-28T04:09:37.073ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61112024-08-28T04:09:37.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61122024-08-28T04:09:37.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61132024-08-28T04:09:37.075ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61142024-08-28T04:09:37.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61152024-08-28T04:09:37.081ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61162024-08-28T04:09:37.083ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.842271ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
61172024-08-28T04:09:37.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61182024-08-28T04:09:37.083ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61192024-08-28T04:09:37.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61202024-08-28T04:09:37.084ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 03:59:37.061406995 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
61212024-08-28T04:09:37.084ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 23.375366ms iteration = 5 status = {"expiration":"2024-08-28T03:59:37.061406995Z","pruned":[]}
61222024-08-28T04:09:37.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61232024-08-28T04:09:37.088ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61242024-08-28T04:09:37.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61252024-08-28T04:09:37.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61262024-08-28T04:09:37.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61272024-08-28T04:09:37.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61282024-08-28T04:09:37.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61292024-08-28T04:09:37.090ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 173396306 } })
61302024-08-28T04:09:37.090ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
61312024-08-28T04:09:37.092ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61322024-08-28T04:09:37.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61332024-08-28T04:09:37.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61342024-08-28T04:09:37.095ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61352024-08-28T04:09:37.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61362024-08-28T04:09:37.096ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61372024-08-28T04:09:37.098ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 181774452 } })
61382024-08-28T04:09:37.099ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61392024-08-28T04:09:37.099ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
61402024-08-28T04:09:37.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
61412024-08-28T04:09:37.101ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61422024-08-28T04:09:37.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61432024-08-28T04:09:37.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61442024-08-28T04:09:37.102ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61452024-08-28T04:09:37.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61462024-08-28T04:09:37.134ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61472024-08-28T04:09:37.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61482024-08-28T04:09:37.136ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61492024-08-28T04:09:37.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61502024-08-28T04:09:37.137ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.172307ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
61512024-08-28T04:09:37.137ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61522024-08-28T04:09:37.140ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61532024-08-28T04:09:37.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61542024-08-28T04:09:37.141ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61552024-08-28T04:09:37.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61562024-08-28T04:09:37.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61572024-08-28T04:09:37.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61582024-08-28T04:09:37.142ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
61592024-08-28T04:09:37.142ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
61602024-08-28T04:09:37.143ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 81.991429ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
61612024-08-28T04:09:37.143ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.927917ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61622024-08-28T04:09:37.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61632024-08-28T04:09:37.143ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 82.099482ms iteration = 9 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
61642024-08-28T04:09:37.144ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61652024-08-28T04:09:37.144ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
61662024-08-28T04:09:37.144ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
61672024-08-28T04:09:37.144ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.577145ms iteration = 5 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
61682024-08-28T04:09:37.146ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61692024-08-28T04:09:37.147ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
61702024-08-28T04:09:37.147ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61712024-08-28T04:09:37.147ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61722024-08-28T04:09:37.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61732024-08-28T04:09:37.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61742024-08-28T04:09:37.149ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61752024-08-28T04:09:37.149ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
61762024-08-28T04:09:37.150ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61772024-08-28T04:09:37.150ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
61782024-08-28T04:09:37.150ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61792024-08-28T04:09:37.150ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.127898ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
61802024-08-28T04:09:37.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61812024-08-28T04:09:37.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61822024-08-28T04:09:37.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61832024-08-28T04:09:37.151ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61842024-08-28T04:09:37.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61852024-08-28T04:09:37.153ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61862024-08-28T04:09:37.153ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61872024-08-28T04:09:37.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61882024-08-28T04:09:37.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61892024-08-28T04:09:37.155ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61902024-08-28T04:09:37.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61912024-08-28T04:09:37.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61922024-08-28T04:09:37.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
61932024-08-28T04:09:37.160ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61942024-08-28T04:09:37.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61952024-08-28T04:09:37.169ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61962024-08-28T04:09:37.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61972024-08-28T04:09:37.173ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61982024-08-28T04:09:37.176ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61992024-08-28T04:09:37.176ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62002024-08-28T04:09:37.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62012024-08-28T04:09:37.187ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
62022024-08-28T04:09:37.187ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 126.623659ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
62032024-08-28T04:09:37.189ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
62042024-08-28T04:09:37.189ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62052024-08-28T04:09:37.189ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 128.042281ms iteration = 9 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
62062024-08-28T04:09:37.192ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62072024-08-28T04:09:37.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62082024-08-28T04:09:37.197ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
62092024-08-28T04:09:37.197ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
62102024-08-28T04:09:37.197ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
62112024-08-28T04:09:37.197ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62122024-08-28T04:09:37.197ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62132024-08-28T04:09:37.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62142024-08-28T04:09:37.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62152024-08-28T04:09:37.200ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62162024-08-28T04:09:37.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62172024-08-28T04:09:37.201ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
62182024-08-28T04:09:37.201ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
62192024-08-28T04:09:37.201ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
62202024-08-28T04:09:37.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62212024-08-28T04:09:37.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62222024-08-28T04:09:37.202ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62232024-08-28T04:09:37.203ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 142.047283ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
62242024-08-28T04:09:37.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62252024-08-28T04:09:37.204ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
62262024-08-28T04:09:37.204ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62272024-08-28T04:09:37.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62282024-08-28T04:09:37.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62292024-08-28T04:09:37.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62302024-08-28T04:09:37.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62312024-08-28T04:09:37.208ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 147.336588ms iteration = 9 status = 0
62322024-08-28T04:09:37.210ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
62332024-08-28T04:09:37.222ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
62342024-08-28T04:09:37.222ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62352024-08-28T04:09:37.223ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c84fc5dd-9376-4869-bb5d-8f6651656f4b", "content-length": "26", "date": "Wed, 28 Aug 2024 04:09:36 GMT"} })
62362024-08-28T04:09:37.223ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62372024-08-28T04:09:37.225ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62382024-08-28T04:09:37.230ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
62392024-08-28T04:09:37.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 169.273672ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
62402024-08-28T04:09:37.236ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T04:05:35.065116Z, time_modified: 2024-08-28T04:05:35.065116Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }) }
62412024-08-28T04:09:37.236ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 175.66192ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]}},"default_endpoint":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
62422024-08-28T04:09:37.242ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
62432024-08-28T04:09:37.242ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 0 version = 2
62442024-08-28T04:09:37.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62452024-08-28T04:09:37.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62462024-08-28T04:09:37.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62472024-08-28T04:09:37.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62482024-08-28T04:09:37.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62492024-08-28T04:09:37.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62502024-08-28T04:09:37.251ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
62512024-08-28T04:09:37.251ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62522024-08-28T04:09:37.253ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "19a19b11-f7de-4bc7-93e3-7099facb67ae", "content-length": "26", "date": "Wed, 28 Aug 2024 04:09:36 GMT"} })
62532024-08-28T04:09:37.253ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62542024-08-28T04:09:37.255ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62552024-08-28T04:09:37.257ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
62562024-08-28T04:09:37.262ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 202.020924ms iteration = 11 status = {"physical_disks_added":0}
62572024-08-28T04:09:37.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62582024-08-28T04:09:37.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62592024-08-28T04:09:37.382ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
62602024-08-28T04:09:37.382ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2bf6141e-e64f-499c-8652-83bf9f143acb", "date": "Wed, 28 Aug 2024 04:09:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
62612024-08-28T04:09:37.383ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
62622024-08-28T04:09:37.384ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "41b8b9af-4cd1-43dc-9554-a80df99d7c23", "date": "Wed, 28 Aug 2024 04:09:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
62632024-08-28T04:09:37.384ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
62642024-08-28T04:09:37.386ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
62652024-08-28T04:09:37.386ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 324.834052ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
62662024-08-28T04:09:37.409ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 zone_address = fd00:1122:3344:101::2
62672024-08-28T04:09:37.409ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62682024-08-28T04:09:37.409ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f5313c14-b2e8-4add-9ace-d765b218bd01", "content-length": "26", "date": "Wed, 28 Aug 2024 04:09:36 GMT"} })
62692024-08-28T04:09:37.409ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62702024-08-28T04:09:37.411ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
62712024-08-28T04:09:37.419ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62722024-08-28T04:09:37.419ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "87d246ba-0a1a-4e3a-997b-ea6f2904ed95", "content-length": "1", "date": "Wed, 28 Aug 2024 04:09:36 GMT"} })
62732024-08-28T04:09:37.421ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62742024-08-28T04:09:37.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62752024-08-28T04:09:37.479ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
62762024-08-28T04:09:37.489ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62772024-08-28T04:09:37.489ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dc60ed65-6204-47d7-a9de-62d8e1c62c59", "content-length": "372", "date": "Wed, 28 Aug 2024 04:09:37 GMT"} })
62782024-08-28T04:09:37.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62792024-08-28T04:09:37.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62802024-08-28T04:09:37.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62812024-08-28T04:09:37.491ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62822024-08-28T04:09:37.492ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 431.402792ms iteration = 9 status = null
62832024-08-28T04:09:37.493ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62842024-08-28T04:09:37.493ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62852024-08-28T04:09:37.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62862024-08-28T04:09:37.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62872024-08-28T04:09:37.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62882024-08-28T04:09:37.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62892024-08-28T04:09:37.495ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62902024-08-28T04:09:37.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62912024-08-28T04:09:37.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62922024-08-28T04:09:37.497ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 1 version = 2
62932024-08-28T04:09:37.497ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
62942024-08-28T04:09:37.497ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 04:05:50.133665 UTC dns_group = external generation = 2
62952024-08-28T04:09:37.497ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 436.027688ms iteration = 6 status = {"generation":2}
62962024-08-28T04:09:37.497ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62972024-08-28T04:09:37.497ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62982024-08-28T04:09:37.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62992024-08-28T04:09:37.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63002024-08-28T04:09:37.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63012024-08-28T04:09:37.502ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63022024-08-28T04:09:37.503ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7d2f133c-cadf-43d2-be45-2128c51bac79", "date": "Wed, 28 Aug 2024 04:09:37 GMT"} })
63032024-08-28T04:09:37.505ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 444.476836ms iteration = 10 status = {}
63042024-08-28T04:09:37.505ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 444.376032ms iteration = 9 status = {}
63052024-08-28T04:09:37.515ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
63062024-08-28T04:09:37.515ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
63072024-08-28T04:09:37.515ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63082024-08-28T04:09:37.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63092024-08-28T04:09:37.516ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63102024-08-28T04:09:37.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63112024-08-28T04:09:37.519ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63122024-08-28T04:09:37.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63132024-08-28T04:09:37.521ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
63142024-08-28T04:09:37.521ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
63152024-08-28T04:09:37.521ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 04:05:49.286960 UTC dns_group = internal generation = 1
63162024-08-28T04:09:37.521ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 460.725162ms iteration = 6 status = {"generation":1}
63172024-08-28T04:09:37.624ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
63182024-08-28T04:09:37.625ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b06d597e-4c03-4eff-a34f-b7d62028ef88", "date": "Wed, 28 Aug 2024 04:09:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
63192024-08-28T04:09:37.625ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
63202024-08-28T04:09:37.627ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c6afa53f-5715-4097-bd73-eaf9a2444297", "date": "Wed, 28 Aug 2024 04:09:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
63212024-08-28T04:09:37.627ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
63222024-08-28T04:09:37.628ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5c32cc46-93d9-4930-8e5d-a218a0598b86", "date": "Wed, 28 Aug 2024 04:09:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
63232024-08-28T04:09:37.628ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
63242024-08-28T04:09:37.630ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
63252024-08-28T04:09:37.630ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 569.098346ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
63262024-08-28T04:09:37.647ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63272024-08-28T04:09:37.658ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63282024-08-28T04:09:37.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63292024-08-28T04:09:37.660ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 21872882-9c7e-4a12-8d80-3d3b1686a012, rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(726f0c10-a692-46cf-962b-4ac9a2a107fc) } rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
63302024-08-28T04:09:37.660ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63312024-08-28T04:09:37.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63322024-08-28T04:09:37.671ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63332024-08-28T04:09:37.671ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "688e2586-ee3c-455f-a74d-c447718f09ee", "content-length": "121", "date": "Wed, 28 Aug 2024 04:09:37 GMT"} })
63342024-08-28T04:09:37.671ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
63352024-08-28T04:09:37.671ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 726f0c10-a692-46cf-962b-4ac9a2a107fc
63362024-08-28T04:09:37.671ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63372024-08-28T04:09:37.672ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63382024-08-28T04:09:37.672ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
63392024-08-28T04:09:37.672ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
63402024-08-28T04:09:37.672ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
63412024-08-28T04:09:37.672ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63422024-08-28T04:09:37.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63432024-08-28T04:09:37.674ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63442024-08-28T04:09:37.674ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1528dd22-49ca-46d5-9548-ff04eecefc6f", "content-length": "2", "date": "Wed, 28 Aug 2024 04:09:37 GMT"} })
63452024-08-28T04:09:37.674ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63462024-08-28T04:09:37.675ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cb0ea08d-8d20-4e71-8091-0844164d6026", "content-length": "50", "date": "Wed, 28 Aug 2024 04:09:37 GMT"} })
63472024-08-28T04:09:37.675ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
63482024-08-28T04:09:37.675ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63492024-08-28T04:09:37.778ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4ea858cf-e294-4df3-b97b-838412b5b61a", "content-length": "691", "date": "Wed, 28 Aug 2024 04:09:37 GMT"} })
63502024-08-28T04:09:37.779ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
63512024-08-28T04:09:37.779ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
63522024-08-28T04:09:37.779ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
63532024-08-28T04:09:37.781ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 719.992348ms iteration = 9 status = {}
63542024-08-28T04:09:37.896ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "eed39350-de5d-4435-9c5b-1ae538865bcf", "date": "Wed, 28 Aug 2024 04:09:37 GMT"} })
63552024-08-28T04:09:37.896ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch = Switch0
63562024-08-28T04:09:37.896ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63572024-08-28T04:09:37.897ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c550b0c7-cf0c-455b-b326-82dee74e8672", "content-length": "667", "date": "Wed, 28 Aug 2024 04:09:37 GMT"} })
63582024-08-28T04:09:37.897ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63592024-08-28T04:09:37.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63602024-08-28T04:09:37.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63612024-08-28T04:09:37.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63622024-08-28T04:09:37.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63632024-08-28T04:09:37.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63642024-08-28T04:09:37.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63652024-08-28T04:09:37.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63662024-08-28T04:09:37.913ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 851.950815ms iteration = 9 status = {}
63672024-08-28T04:09:41.172ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1200 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 84ec30b1-f07d-4cf8-a012-73734f2af1e0 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
63682024-08-28T04:09:47.060ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
63692024-08-28T04:09:47.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63702024-08-28T04:09:47.060ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
63712024-08-28T04:09:47.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63722024-08-28T04:09:47.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63732024-08-28T04:09:47.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63742024-08-28T04:09:47.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63752024-08-28T04:09:47.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63762024-08-28T04:09:47.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63772024-08-28T04:09:47.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.789072ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63782024-08-28T04:09:47.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63792024-08-28T04:09:47.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63802024-08-28T04:09:47.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63812024-08-28T04:09:47.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63822024-08-28T04:09:47.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63832024-08-28T04:09:47.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63842024-08-28T04:09:47.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
63852024-08-28T04:09:47.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63862024-08-28T04:09:47.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63872024-08-28T04:09:47.077ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
63882024-08-28T04:09:47.077ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.646529ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
63892024-08-28T04:09:51.172ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1181 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 01926351-4e8a-41a8-a5df-6a1e0284d997 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
63902024-08-28T04:09:56.489ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:33983
63912024-08-28T04:09:56.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33983 req_id = 099d8740-6e46-44f6-a1d9-8cd1d13a3566 roles = RoleSet { roles: {} } uri = /metrics/producers
63922024-08-28T04:09:56.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33983 req_id = 099d8740-6e46-44f6-a1d9-8cd1d13a3566 resource = Database result = Ok(()) uri = /metrics/producers
63932024-08-28T04:09:56.522ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
63942024-08-28T04:09:56.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33983 req_id = 099d8740-6e46-44f6-a1d9-8cd1d13a3566 roles = RoleSet { roles: {} } uri = /metrics/producers
63952024-08-28T04:09:56.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33983 req_id = 099d8740-6e46-44f6-a1d9-8cd1d13a3566 resource = Database result = Ok(()) uri = /metrics/producers
63962024-08-28T04:09:56.527ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
63972024-08-28T04:09:56.527ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ae82d20e-26fb-43b3-8237-0e58f3e5a139", "date": "Wed, 28 Aug 2024 04:09:56 GMT"} })
63982024-08-28T04:09:56.527ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 5c7c3da2-1911-473e-8087-8b75e35a21c4
63992024-08-28T04:09:56.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 38929 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33983 req_id = 099d8740-6e46-44f6-a1d9-8cd1d13a3566 response_code = 201 uri = /metrics/producers
64002024-08-28T04:09:57.060ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
64012024-08-28T04:09:57.060ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
64022024-08-28T04:09:57.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64032024-08-28T04:09:57.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64042024-08-28T04:09:57.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64052024-08-28T04:09:57.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64062024-08-28T04:09:57.063ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64072024-08-28T04:09:57.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64082024-08-28T04:09:57.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64092024-08-28T04:09:57.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.019928ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64102024-08-28T04:09:57.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64112024-08-28T04:09:57.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64122024-08-28T04:09:57.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64132024-08-28T04:09:57.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64142024-08-28T04:09:57.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64152024-08-28T04:09:57.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64162024-08-28T04:09:57.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
64172024-08-28T04:09:57.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64182024-08-28T04:09:57.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64192024-08-28T04:09:57.078ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
64202024-08-28T04:09:57.078ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.781502ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
64212024-08-28T04:10:01.172ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1331 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = b53eb3ae-1ae7-4666-86c2-b0937dcbb7d7 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
64222024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
64232024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
64242024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64252024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64262024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
64272024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
64282024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
64292024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64302024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
64312024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64322024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
64332024-08-28T04:10:07.060ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
64342024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64352024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
64362024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
64372024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64382024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64392024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
64402024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64412024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
64422024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64432024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
64442024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
64452024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64462024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
64472024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
64482024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64492024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
64502024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
64512024-08-28T04:10:07.060ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
64522024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64532024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
64542024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64552024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64562024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
64572024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64582024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64592024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64602024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64612024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64622024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
64632024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64642024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64652024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64662024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64672024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64682024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64692024-08-28T04:10:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64702024-08-28T04:10:07.063ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64712024-08-28T04:10:07.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64722024-08-28T04:10:07.064ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.710569ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64732024-08-28T04:10:07.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64742024-08-28T04:10:07.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
64752024-08-28T04:10:07.066ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64762024-08-28T04:10:07.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64772024-08-28T04:10:07.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64782024-08-28T04:10:07.067ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64792024-08-28T04:10:07.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64802024-08-28T04:10:07.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64812024-08-28T04:10:07.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64822024-08-28T04:10:07.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64832024-08-28T04:10:07.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64842024-08-28T04:10:07.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64852024-08-28T04:10:07.074ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1294, tv_nsec: 158205900 } })
64862024-08-28T04:10:07.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64872024-08-28T04:10:07.075ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
64882024-08-28T04:10:07.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64892024-08-28T04:10:07.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64902024-08-28T04:10:07.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64912024-08-28T04:10:07.076ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1294, tv_nsec: 160338322 } })
64922024-08-28T04:10:07.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
64932024-08-28T04:10:07.077ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64942024-08-28T04:10:07.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64952024-08-28T04:10:07.077ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
64962024-08-28T04:10:07.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
64972024-08-28T04:10:07.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64982024-08-28T04:10:07.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64992024-08-28T04:10:07.078ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65002024-08-28T04:10:07.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65012024-08-28T04:10:07.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65022024-08-28T04:10:07.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65032024-08-28T04:10:07.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65042024-08-28T04:10:07.083ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65052024-08-28T04:10:07.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65062024-08-28T04:10:07.083ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65072024-08-28T04:10:07.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65082024-08-28T04:10:07.084ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1294, tv_nsec: 168034179 } })
65092024-08-28T04:10:07.085ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65102024-08-28T04:10:07.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65112024-08-28T04:10:07.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65122024-08-28T04:10:07.085ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
65132024-08-28T04:10:07.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65142024-08-28T04:10:07.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65152024-08-28T04:10:07.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65162024-08-28T04:10:07.094ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65172024-08-28T04:10:07.094ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65182024-08-28T04:10:07.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65192024-08-28T04:10:07.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65202024-08-28T04:10:07.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65212024-08-28T04:10:07.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65222024-08-28T04:10:07.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65232024-08-28T04:10:07.107ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.815596ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
65242024-08-28T04:10:07.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65252024-08-28T04:10:07.111ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65262024-08-28T04:10:07.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65272024-08-28T04:10:07.112ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65282024-08-28T04:10:07.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65292024-08-28T04:10:07.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
65302024-08-28T04:10:07.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65312024-08-28T04:10:07.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65322024-08-28T04:10:07.117ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 56.252952ms iteration = 10 status = 0
65332024-08-28T04:10:07.121ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65342024-08-28T04:10:07.121ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65352024-08-28T04:10:07.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65362024-08-28T04:10:07.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65372024-08-28T04:10:07.124ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65382024-08-28T04:10:07.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65392024-08-28T04:10:07.126ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 65.601587ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
65402024-08-28T04:10:07.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65412024-08-28T04:10:07.126ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
65422024-08-28T04:10:07.126ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
65432024-08-28T04:10:07.126ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65442024-08-28T04:10:07.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65452024-08-28T04:10:07.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
65462024-08-28T04:10:07.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65472024-08-28T04:10:07.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65482024-08-28T04:10:07.131ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65492024-08-28T04:10:07.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65502024-08-28T04:10:07.133ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65512024-08-28T04:10:07.133ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65522024-08-28T04:10:07.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65532024-08-28T04:10:07.135ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65542024-08-28T04:10:07.135ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65552024-08-28T04:10:07.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65562024-08-28T04:10:07.138ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
65572024-08-28T04:10:07.138ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.472006ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
65582024-08-28T04:10:07.155ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
65592024-08-28T04:10:07.155ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 94.340491ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
65602024-08-28T04:10:07.158ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
65612024-08-28T04:10:07.158ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65622024-08-28T04:10:07.159ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "29dd97ce-1387-48e6-84ac-a73f81526c2b", "content-length": "26", "date": "Wed, 28 Aug 2024 04:10:07 GMT"} })
65632024-08-28T04:10:07.159ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65642024-08-28T04:10:07.162ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65652024-08-28T04:10:07.164ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
65662024-08-28T04:10:07.164ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 103.761447ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
65672024-08-28T04:10:07.165ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 104.615053ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65682024-08-28T04:10:07.168ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 zone_address = fd00:1122:3344:101::2
65692024-08-28T04:10:07.168ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65702024-08-28T04:10:07.168ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2f54be78-39a2-4cfc-a846-f150189c685f", "content-length": "26", "date": "Wed, 28 Aug 2024 04:10:07 GMT"} })
65712024-08-28T04:10:07.168ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65722024-08-28T04:10:07.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 107.713664ms iteration = 10 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
65732024-08-28T04:10:07.168ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
65742024-08-28T04:10:07.168ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
65752024-08-28T04:10:07.168ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.617371ms iteration = 10 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
65762024-08-28T04:10:07.169ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
65772024-08-28T04:10:07.226ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 166.069798ms iteration = 12 status = {"physical_disks_added":0}
65782024-08-28T04:10:07.230ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
65792024-08-28T04:10:07.230ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65802024-08-28T04:10:07.230ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8a6a1670-54d3-4a18-9ae2-eb9cac6738bc", "content-length": "26", "date": "Wed, 28 Aug 2024 04:10:07 GMT"} })
65812024-08-28T04:10:07.230ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65822024-08-28T04:10:07.233ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65832024-08-28T04:10:07.337ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65842024-08-28T04:10:07.338ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "61d0b1dd-ae39-4d6d-bf4d-76a9a6b484a9", "content-length": "372", "date": "Wed, 28 Aug 2024 04:10:06 GMT"} })
65852024-08-28T04:10:07.338ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65862024-08-28T04:10:07.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65872024-08-28T04:10:07.349ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
65882024-08-28T04:10:07.349ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "989f9e61-c66d-4bc2-a6a5-bc473b1a10e3", "content-length": "691", "date": "Wed, 28 Aug 2024 04:10:06 GMT"} })
65892024-08-28T04:10:07.349ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
65902024-08-28T04:10:07.349ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
65912024-08-28T04:10:07.349ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
65922024-08-28T04:10:07.351ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 291.145112ms iteration = 10 status = {}
65932024-08-28T04:10:07.352ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65942024-08-28T04:10:07.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65952024-08-28T04:10:07.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65962024-08-28T04:10:07.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65972024-08-28T04:10:07.358ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65982024-08-28T04:10:07.358ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4fd2604e-6189-45cd-ae04-18584e558ad7", "date": "Wed, 28 Aug 2024 04:10:06 GMT"} })
65992024-08-28T04:10:07.361ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 300.141986ms iteration = 11 status = {}
66002024-08-28T04:10:07.363ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 302.649259ms iteration = 10 status = {}
66012024-08-28T04:10:07.392ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
66022024-08-28T04:10:07.393ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "85cadf12-0092-4045-a867-8d2c104e8982", "content-length": "1", "date": "Wed, 28 Aug 2024 04:10:06 GMT"} })
66032024-08-28T04:10:07.395ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66042024-08-28T04:10:07.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66052024-08-28T04:10:07.397ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 336.605048ms iteration = 10 status = null
66062024-08-28T04:10:07.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66072024-08-28T04:10:07.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66082024-08-28T04:10:07.436ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 21872882-9c7e-4a12-8d80-3d3b1686a012, rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(726f0c10-a692-46cf-962b-4ac9a2a107fc) } rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
66092024-08-28T04:10:07.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66102024-08-28T04:10:07.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66112024-08-28T04:10:07.450ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
66122024-08-28T04:10:07.450ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d0815ee6-32e7-45e4-8863-ff005d543091", "content-length": "121", "date": "Wed, 28 Aug 2024 04:10:06 GMT"} })
66132024-08-28T04:10:07.450ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
66142024-08-28T04:10:07.450ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 726f0c10-a692-46cf-962b-4ac9a2a107fc
66152024-08-28T04:10:07.450ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
66162024-08-28T04:10:07.450ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
66172024-08-28T04:10:07.450ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
66182024-08-28T04:10:07.450ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
66192024-08-28T04:10:07.450ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
66202024-08-28T04:10:07.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66212024-08-28T04:10:07.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66222024-08-28T04:10:07.456ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
66232024-08-28T04:10:07.456ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d46c0c9a-e3e6-4ce9-93f5-8ac3133b151a", "content-length": "2", "date": "Wed, 28 Aug 2024 04:10:06 GMT"} })
66242024-08-28T04:10:07.456ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
66252024-08-28T04:10:07.457ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "daba6108-3f2b-46dd-883f-80eb49a35bdf", "content-length": "50", "date": "Wed, 28 Aug 2024 04:10:06 GMT"} })
66262024-08-28T04:10:07.457ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
66272024-08-28T04:10:07.457ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
66282024-08-28T04:10:07.591ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f5965dca-9d0f-4dee-9b84-04965275b7df", "date": "Wed, 28 Aug 2024 04:10:06 GMT"} })
66292024-08-28T04:10:07.591ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch = Switch0
66302024-08-28T04:10:07.591ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
66312024-08-28T04:10:07.591ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a7d2aec1-5e29-482c-aa4c-63f14adf120d", "content-length": "667", "date": "Wed, 28 Aug 2024 04:10:07 GMT"} })
66322024-08-28T04:10:07.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66332024-08-28T04:10:07.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66342024-08-28T04:10:07.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66352024-08-28T04:10:07.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66362024-08-28T04:10:07.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66372024-08-28T04:10:07.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66382024-08-28T04:10:07.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66392024-08-28T04:10:07.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66402024-08-28T04:10:07.608ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 547.145421ms iteration = 10 status = {}
66412024-08-28T04:10:11.172ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1285 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = ae56473b-821f-4e44-9c67-ef669cd87413 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
66422024-08-28T04:10:16.905ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:52597
66432024-08-28T04:10:16.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52597 req_id = 632bef67-f104-426f-9152-76dd7309b444 roles = RoleSet { roles: {} } uri = /metrics/producers
66442024-08-28T04:10:16.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52597 req_id = 632bef67-f104-426f-9152-76dd7309b444 resource = Database result = Ok(()) uri = /metrics/producers
66452024-08-28T04:10:16.937ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
66462024-08-28T04:10:16.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52597 req_id = 632bef67-f104-426f-9152-76dd7309b444 roles = RoleSet { roles: {} } uri = /metrics/producers
66472024-08-28T04:10:16.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52597 req_id = 632bef67-f104-426f-9152-76dd7309b444 resource = Database result = Ok(()) uri = /metrics/producers
66482024-08-28T04:10:16.969ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
66492024-08-28T04:10:16.970ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a9764e2f-d9cb-49cf-a855-95a21b54292c", "date": "Wed, 28 Aug 2024 04:10:16 GMT"} })
66502024-08-28T04:10:16.970ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = f62e5a13-51f3-4379-acf3-2f8e8601ac1f
66512024-08-28T04:10:16.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 65163 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52597 req_id = 632bef67-f104-426f-9152-76dd7309b444 response_code = 201 uri = /metrics/producers
66522024-08-28T04:10:17.060ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
66532024-08-28T04:10:17.060ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
66542024-08-28T04:10:17.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66552024-08-28T04:10:17.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66562024-08-28T04:10:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66572024-08-28T04:10:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66582024-08-28T04:10:17.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66592024-08-28T04:10:17.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66602024-08-28T04:10:17.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66612024-08-28T04:10:17.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66622024-08-28T04:10:17.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66632024-08-28T04:10:17.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66642024-08-28T04:10:17.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66652024-08-28T04:10:17.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66662024-08-28T04:10:17.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66672024-08-28T04:10:17.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
66682024-08-28T04:10:17.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66692024-08-28T04:10:17.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66702024-08-28T04:10:17.112ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
66712024-08-28T04:10:17.112ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.665897ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
66722024-08-28T04:10:17.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.635341ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66732024-08-28T04:10:21.173ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1463 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 66df41e2-a3a6-4cee-ac62-815627d71817 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
66742024-08-28T04:10:27.060ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
66752024-08-28T04:10:27.060ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
66762024-08-28T04:10:27.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66772024-08-28T04:10:27.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66782024-08-28T04:10:27.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66792024-08-28T04:10:27.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66802024-08-28T04:10:27.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66812024-08-28T04:10:27.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66822024-08-28T04:10:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66832024-08-28T04:10:27.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66842024-08-28T04:10:27.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66852024-08-28T04:10:27.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66862024-08-28T04:10:27.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66872024-08-28T04:10:27.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66882024-08-28T04:10:27.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66892024-08-28T04:10:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
66902024-08-28T04:10:27.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66912024-08-28T04:10:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66922024-08-28T04:10:27.078ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
66932024-08-28T04:10:27.078ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.123153ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
66942024-08-28T04:10:27.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.796836ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66952024-08-28T04:10:31.172ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1200 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 17a6319a-b57e-44c9-b6b0-321fa1ecbfc9 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
66962024-08-28T04:10:37.059ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
66972024-08-28T04:10:37.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66982024-08-28T04:10:37.059ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
66992024-08-28T04:10:37.059ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
67002024-08-28T04:10:37.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67012024-08-28T04:10:37.059ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
67022024-08-28T04:10:37.059ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
67032024-08-28T04:10:37.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67042024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67052024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
67062024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
67072024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
67082024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
67092024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67102024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67112024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
67122024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67132024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67142024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
67152024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
67162024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67172024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
67182024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67192024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
67202024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67212024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
67222024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67232024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
67242024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
67252024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
67262024-08-28T04:10:37.060ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
67272024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
67282024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67292024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67302024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
67312024-08-28T04:10:37.060ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 04:00:37.060127766 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
67322024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
67332024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
67342024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
67352024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
67362024-08-28T04:10:37.060ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
67372024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
67382024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67392024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
67402024-08-28T04:10:37.060ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
67412024-08-28T04:10:37.060ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764
67422024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
67432024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.501\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764"}
67442024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
67452024-08-28T04:10:37.060ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
67462024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67472024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
67482024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
67492024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
67502024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
67512024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
67522024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67532024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
67542024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67552024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
67562024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
67572024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67582024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67592024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67602024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67612024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67622024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67632024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67642024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67652024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67662024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67672024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67682024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67692024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67702024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67712024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67722024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67732024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
67742024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
67752024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67762024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67772024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67782024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67792024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
67802024-08-28T04:10:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67812024-08-28T04:10:37.061ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("037b07ce-9e39-4982-8c20-c4c38f448b97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4e2ba65e-422a-4b1e-b0e3-85f8149a979a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 145040393 } })
67822024-08-28T04:10:37.061ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4eb364e4-14a2-46c4-b173-eb2890920e8f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 145075474 } })
67832024-08-28T04:10:37.062ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
67842024-08-28T04:10:37.062ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.615597ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
67852024-08-28T04:10:37.064ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67862024-08-28T04:10:37.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67872024-08-28T04:10:37.064ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
67882024-08-28T04:10:37.064ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.09166ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
67892024-08-28T04:10:37.064ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67902024-08-28T04:10:37.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67912024-08-28T04:10:37.065ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67922024-08-28T04:10:37.065ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.498192ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67932024-08-28T04:10:37.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67942024-08-28T04:10:37.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67952024-08-28T04:10:37.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67962024-08-28T04:10:37.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67972024-08-28T04:10:37.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67982024-08-28T04:10:37.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67992024-08-28T04:10:37.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
68002024-08-28T04:10:37.069ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68012024-08-28T04:10:37.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68022024-08-28T04:10:37.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68032024-08-28T04:10:37.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68042024-08-28T04:10:37.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68052024-08-28T04:10:37.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68062024-08-28T04:10:37.076ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68072024-08-28T04:10:37.079ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68082024-08-28T04:10:37.079ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68092024-08-28T04:10:37.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68102024-08-28T04:10:37.087ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68112024-08-28T04:10:37.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68122024-08-28T04:10:37.088ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 04:00:37.060127766 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
68132024-08-28T04:10:37.088ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 28.356313ms iteration = 6 status = {"expiration":"2024-08-28T04:00:37.060127766Z","pruned":[]}
68142024-08-28T04:10:37.089ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68152024-08-28T04:10:37.089ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
68162024-08-28T04:10:37.089ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
68172024-08-28T04:10:37.089ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 28.995192ms iteration = 6 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
68182024-08-28T04:10:37.089ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 173215811 } })
68192024-08-28T04:10:37.089ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 173219381 } })
68202024-08-28T04:10:37.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68212024-08-28T04:10:37.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68222024-08-28T04:10:37.091ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 30.97686ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
68232024-08-28T04:10:37.091ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
68242024-08-28T04:10:37.091ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
68252024-08-28T04:10:37.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68262024-08-28T04:10:37.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68272024-08-28T04:10:37.093ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68282024-08-28T04:10:37.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68292024-08-28T04:10:37.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68302024-08-28T04:10:37.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
68312024-08-28T04:10:37.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68322024-08-28T04:10:37.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68332024-08-28T04:10:37.095ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68342024-08-28T04:10:37.095ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68352024-08-28T04:10:37.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68362024-08-28T04:10:37.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68372024-08-28T04:10:37.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68382024-08-28T04:10:37.099ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68392024-08-28T04:10:37.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68402024-08-28T04:10:37.105ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 189592872 } })
68412024-08-28T04:10:37.107ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
68422024-08-28T04:10:37.123ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
68432024-08-28T04:10:37.123ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68442024-08-28T04:10:37.123ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68452024-08-28T04:10:37.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68462024-08-28T04:10:37.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.924958ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
68472024-08-28T04:10:37.129ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68482024-08-28T04:10:37.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68492024-08-28T04:10:37.132ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68502024-08-28T04:10:37.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.706255ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68512024-08-28T04:10:37.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68522024-08-28T04:10:37.136ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68532024-08-28T04:10:37.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68542024-08-28T04:10:37.139ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68552024-08-28T04:10:37.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68562024-08-28T04:10:37.141ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68572024-08-28T04:10:37.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68582024-08-28T04:10:37.143ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68592024-08-28T04:10:37.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68602024-08-28T04:10:37.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68612024-08-28T04:10:37.144ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68622024-08-28T04:10:37.144ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68632024-08-28T04:10:37.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68642024-08-28T04:10:37.145ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68652024-08-28T04:10:37.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68662024-08-28T04:10:37.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68672024-08-28T04:10:37.147ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68682024-08-28T04:10:37.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68692024-08-28T04:10:37.149ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 89.420127ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
68702024-08-28T04:10:37.150ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68712024-08-28T04:10:37.150ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68722024-08-28T04:10:37.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68732024-08-28T04:10:37.151ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68742024-08-28T04:10:37.152ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68752024-08-28T04:10:37.155ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
68762024-08-28T04:10:37.155ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68772024-08-28T04:10:37.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68782024-08-28T04:10:37.156ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
68792024-08-28T04:10:37.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68802024-08-28T04:10:37.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68812024-08-28T04:10:37.157ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68822024-08-28T04:10:37.160ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68832024-08-28T04:10:37.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
68842024-08-28T04:10:37.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68852024-08-28T04:10:37.161ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
68862024-08-28T04:10:37.161ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 101.232193ms iteration = 11 status = 0
68872024-08-28T04:10:37.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
68882024-08-28T04:10:37.163ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68892024-08-28T04:10:37.165ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68902024-08-28T04:10:37.165ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68912024-08-28T04:10:37.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68922024-08-28T04:10:37.168ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68932024-08-28T04:10:37.171ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
68942024-08-28T04:10:37.171ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 111.537646ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
68952024-08-28T04:10:37.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
68962024-08-28T04:10:37.172ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68972024-08-28T04:10:37.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68982024-08-28T04:10:37.174ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68992024-08-28T04:10:37.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69002024-08-28T04:10:37.176ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 116.365468ms iteration = 11 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
69012024-08-28T04:10:37.177ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69022024-08-28T04:10:37.179ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69032024-08-28T04:10:37.179ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69042024-08-28T04:10:37.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69052024-08-28T04:10:37.182ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
69062024-08-28T04:10:37.182ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
69072024-08-28T04:10:37.182ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.640742ms iteration = 11 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
69082024-08-28T04:10:37.184ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69092024-08-28T04:10:37.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69102024-08-28T04:10:37.187ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69112024-08-28T04:10:37.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69122024-08-28T04:10:37.189ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
69132024-08-28T04:10:37.189ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
69142024-08-28T04:10:37.189ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
69152024-08-28T04:10:37.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69162024-08-28T04:10:37.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69172024-08-28T04:10:37.189ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69182024-08-28T04:10:37.190ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
69192024-08-28T04:10:37.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69202024-08-28T04:10:37.193ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
69212024-08-28T04:10:37.193ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69222024-08-28T04:10:37.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69232024-08-28T04:10:37.196ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69242024-08-28T04:10:37.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69252024-08-28T04:10:37.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69262024-08-28T04:10:37.197ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69272024-08-28T04:10:37.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69282024-08-28T04:10:37.199ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69292024-08-28T04:10:37.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69302024-08-28T04:10:37.200ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69312024-08-28T04:10:37.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69322024-08-28T04:10:37.201ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
69332024-08-28T04:10:37.201ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 141.678422ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
69342024-08-28T04:10:37.205ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
69352024-08-28T04:10:37.205ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
69362024-08-28T04:10:37.205ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
69372024-08-28T04:10:37.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69382024-08-28T04:10:37.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69392024-08-28T04:10:37.214ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
69402024-08-28T04:10:37.214ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
69412024-08-28T04:10:37.214ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 154.096976ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
69422024-08-28T04:10:37.217ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
69432024-08-28T04:10:37.224ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T04:05:35.065116Z, time_modified: 2024-08-28T04:05:35.065116Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }) }
69442024-08-28T04:10:37.224ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 164.390969ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]}},"default_endpoint":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
69452024-08-28T04:10:37.251ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69462024-08-28T04:10:37.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69472024-08-28T04:10:37.269ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 208.962748ms iteration = 13 status = {"physical_disks_added":0}
69482024-08-28T04:10:37.293ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 zone_address = fd00:1122:3344:101::2
69492024-08-28T04:10:37.293ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69502024-08-28T04:10:37.293ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "510a62bc-d221-47f0-85f2-ffcdc77df6fd", "content-length": "26", "date": "Wed, 28 Aug 2024 04:10:36 GMT"} })
69512024-08-28T04:10:37.293ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69522024-08-28T04:10:37.295ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
69532024-08-28T04:10:37.328ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
69542024-08-28T04:10:37.328ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "232a856b-2553-4ecc-98ba-ed6628e8698f", "date": "Wed, 28 Aug 2024 04:10:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69552024-08-28T04:10:37.328ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69562024-08-28T04:10:37.330ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "368291ed-edbb-43dd-9a64-e3eda4bb97a8", "date": "Wed, 28 Aug 2024 04:10:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69572024-08-28T04:10:37.330ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69582024-08-28T04:10:37.332ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69592024-08-28T04:10:37.332ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 271.765353ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
69602024-08-28T04:10:37.369ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69612024-08-28T04:10:37.370ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aa402fcf-1f3b-4c0d-a48a-4db7c37e4327", "content-length": "372", "date": "Wed, 28 Aug 2024 04:10:37 GMT"} })
69622024-08-28T04:10:37.370ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69632024-08-28T04:10:37.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69642024-08-28T04:10:37.371ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69652024-08-28T04:10:37.372ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
69662024-08-28T04:10:37.372ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
69672024-08-28T04:10:37.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69682024-08-28T04:10:37.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69692024-08-28T04:10:37.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69702024-08-28T04:10:37.374ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
69712024-08-28T04:10:37.374ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69722024-08-28T04:10:37.374ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69732024-08-28T04:10:37.374ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69742024-08-28T04:10:37.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69752024-08-28T04:10:37.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69762024-08-28T04:10:37.378ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69772024-08-28T04:10:37.379ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69782024-08-28T04:10:37.380ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69792024-08-28T04:10:37.380ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69802024-08-28T04:10:37.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69812024-08-28T04:10:37.380ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69822024-08-28T04:10:37.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69832024-08-28T04:10:37.381ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
69842024-08-28T04:10:37.381ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 0 version = 2
69852024-08-28T04:10:37.381ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69862024-08-28T04:10:37.382ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
69872024-08-28T04:10:37.382ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69882024-08-28T04:10:37.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69892024-08-28T04:10:37.382ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69902024-08-28T04:10:37.382ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "901f738d-81f0-4470-b31d-f6a75e894cea", "content-length": "26", "date": "Wed, 28 Aug 2024 04:10:36 GMT"} })
69912024-08-28T04:10:37.382ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69922024-08-28T04:10:37.382ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69932024-08-28T04:10:37.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69942024-08-28T04:10:37.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69952024-08-28T04:10:37.382ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69962024-08-28T04:10:37.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69972024-08-28T04:10:37.384ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69982024-08-28T04:10:37.384ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69992024-08-28T04:10:37.384ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70002024-08-28T04:10:37.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70012024-08-28T04:10:37.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70022024-08-28T04:10:37.384ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70032024-08-28T04:10:37.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70042024-08-28T04:10:37.384ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
70052024-08-28T04:10:37.384ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70062024-08-28T04:10:37.385ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f86d43a6-d0c6-422c-ab86-24e91d3105ec", "content-length": "26", "date": "Wed, 28 Aug 2024 04:10:36 GMT"} })
70072024-08-28T04:10:37.385ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70082024-08-28T04:10:37.385ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70092024-08-28T04:10:37.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70102024-08-28T04:10:37.386ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
70112024-08-28T04:10:37.386ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
70122024-08-28T04:10:37.386ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 04:05:49.286960 UTC dns_group = internal generation = 1
70132024-08-28T04:10:37.386ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 326.004646ms iteration = 7 status = {"generation":1}
70142024-08-28T04:10:37.387ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70152024-08-28T04:10:37.387ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70162024-08-28T04:10:37.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70172024-08-28T04:10:37.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70182024-08-28T04:10:37.387ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "81a23018-e79e-440c-8d9e-0ee448e56cc2", "date": "Wed, 28 Aug 2024 04:10:37 GMT"} })
70192024-08-28T04:10:37.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70202024-08-28T04:10:37.389ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
70212024-08-28T04:10:37.389ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70222024-08-28T04:10:37.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70232024-08-28T04:10:37.389ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 329.88527ms iteration = 12 status = {}
70242024-08-28T04:10:37.390ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 1 version = 2
70252024-08-28T04:10:37.390ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
70262024-08-28T04:10:37.390ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 04:05:50.133665 UTC dns_group = external generation = 2
70272024-08-28T04:10:37.390ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 330.54972ms iteration = 7 status = {"generation":2}
70282024-08-28T04:10:37.391ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70292024-08-28T04:10:37.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70302024-08-28T04:10:37.392ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70312024-08-28T04:10:37.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70322024-08-28T04:10:37.393ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70332024-08-28T04:10:37.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70342024-08-28T04:10:37.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70352024-08-28T04:10:37.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
70362024-08-28T04:10:37.398ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70372024-08-28T04:10:37.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70382024-08-28T04:10:37.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70392024-08-28T04:10:37.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70402024-08-28T04:10:37.401ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70412024-08-28T04:10:37.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70422024-08-28T04:10:37.404ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70432024-08-28T04:10:37.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70442024-08-28T04:10:37.404ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
70452024-08-28T04:10:37.404ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 344.268832ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
70462024-08-28T04:10:37.406ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70472024-08-28T04:10:37.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70482024-08-28T04:10:37.407ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70492024-08-28T04:10:37.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70502024-08-28T04:10:37.409ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70512024-08-28T04:10:37.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70522024-08-28T04:10:37.410ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70532024-08-28T04:10:37.414ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
70542024-08-28T04:10:37.414ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70552024-08-28T04:10:37.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70562024-08-28T04:10:37.415ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70572024-08-28T04:10:37.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70582024-08-28T04:10:37.416ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70592024-08-28T04:10:37.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70602024-08-28T04:10:37.417ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70612024-08-28T04:10:37.421ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
70622024-08-28T04:10:37.421ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70632024-08-28T04:10:37.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70642024-08-28T04:10:37.425ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70652024-08-28T04:10:37.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70662024-08-28T04:10:37.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70672024-08-28T04:10:37.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70682024-08-28T04:10:37.430ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70692024-08-28T04:10:37.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70702024-08-28T04:10:37.432ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70712024-08-28T04:10:37.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70722024-08-28T04:10:37.434ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70732024-08-28T04:10:37.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70742024-08-28T04:10:37.436ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70752024-08-28T04:10:37.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70762024-08-28T04:10:37.438ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70772024-08-28T04:10:37.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70782024-08-28T04:10:37.489ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 429.488046ms iteration = 11 status = {}
70792024-08-28T04:10:37.491ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
70802024-08-28T04:10:37.491ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "80f2ae66-4447-453d-8748-169692c76dfd", "content-length": "1", "date": "Wed, 28 Aug 2024 04:10:36 GMT"} })
70812024-08-28T04:10:37.493ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70822024-08-28T04:10:37.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70832024-08-28T04:10:37.496ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
70842024-08-28T04:10:37.496ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "66ddf16c-981c-40fc-8e5f-9913ce5c54f8", "date": "Wed, 28 Aug 2024 04:10:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
70852024-08-28T04:10:37.496ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
70862024-08-28T04:10:37.498ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f9661a90-5f1e-4821-a242-45b2f7f26480", "date": "Wed, 28 Aug 2024 04:10:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
70872024-08-28T04:10:37.498ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
70882024-08-28T04:10:37.500ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d943c84a-d70c-498d-8148-857d18b8d16d", "date": "Wed, 28 Aug 2024 04:10:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
70892024-08-28T04:10:37.500ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
70902024-08-28T04:10:37.502ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
70912024-08-28T04:10:37.502ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 442.373814ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
70922024-08-28T04:10:37.522ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
70932024-08-28T04:10:37.524ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8a1e0905-f675-4a05-a54b-c410b945f13f", "content-length": "691", "date": "Wed, 28 Aug 2024 04:10:37 GMT"} })
70942024-08-28T04:10:37.524ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70952024-08-28T04:10:37.524ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
70962024-08-28T04:10:37.524ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
70972024-08-28T04:10:37.524ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
70982024-08-28T04:10:37.525ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 465.096532ms iteration = 11 status = null
70992024-08-28T04:10:37.525ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 465.461882ms iteration = 11 status = {}
71002024-08-28T04:10:37.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
71012024-08-28T04:10:37.527ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71022024-08-28T04:10:37.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71032024-08-28T04:10:37.529ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71042024-08-28T04:10:37.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71052024-08-28T04:10:37.530ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71062024-08-28T04:10:37.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71072024-08-28T04:10:37.534ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71082024-08-28T04:10:37.540ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
71092024-08-28T04:10:37.540ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71102024-08-28T04:10:37.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71112024-08-28T04:10:37.547ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 0cddb53a-efd3-4f89-93d7-81b182af0cdb, kind: Service { id: 1c6ee351-cab6-4c23-8658-c31bac40b40a }, name: Name("nexus-1c6ee351-cab6-4c23-8658-c31bac40b40a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 245])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1a83b6d1-627c-41ca-8268-a29f26800e91, kind: Service { id: 4c8a8ded-ced6-466f-8626-7fd39c37d020 }, name: Name("nexus-4c8a8ded-ced6-466f-8626-7fd39c37d020"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 34a49c6e-26fe-4abd-8702-695d279dbdca, kind: Service { id: bda2ed8e-2ea5-41eb-824b-d14527b76b8b }, name: Name("nexus-bda2ed8e-2ea5-41eb-824b-d14527b76b8b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 4b747939-586b-48cb-a488-7f7f972db309, kind: Service { id: 4eb364e4-14a2-46c4-b173-eb2890920e8f }, name: Name("external-dns-4eb364e4-14a2-46c4-b173-eb2890920e8f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 113])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a3e0f17f-d79d-4cc0-ba0f-997e844ad5f3, kind: Service { id: 94b35d7a-af71-4078-a57c-874ff9a27068 }, name: Name("external-dns-94b35d7a-af71-4078-a57c-874ff9a27068"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 179])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
71122024-08-28T04:10:37.547ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71132024-08-28T04:10:37.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71142024-08-28T04:10:37.548ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71152024-08-28T04:10:37.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
71162024-08-28T04:10:37.551ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71172024-08-28T04:10:37.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71182024-08-28T04:10:37.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71192024-08-28T04:10:37.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71202024-08-28T04:10:37.560ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 21872882-9c7e-4a12-8d80-3d3b1686a012, rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(726f0c10-a692-46cf-962b-4ac9a2a107fc) } rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
71212024-08-28T04:10:37.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71222024-08-28T04:10:37.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71232024-08-28T04:10:37.568ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
71242024-08-28T04:10:37.569ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cfa8aab2-1e25-4454-b1dd-15cabbad41ca", "content-length": "121", "date": "Wed, 28 Aug 2024 04:10:36 GMT"} })
71252024-08-28T04:10:37.569ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
71262024-08-28T04:10:37.569ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 726f0c10-a692-46cf-962b-4ac9a2a107fc
71272024-08-28T04:10:37.569ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
71282024-08-28T04:10:37.569ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
71292024-08-28T04:10:37.569ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
71302024-08-28T04:10:37.569ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
71312024-08-28T04:10:37.569ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
71322024-08-28T04:10:37.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71332024-08-28T04:10:37.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71342024-08-28T04:10:37.572ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
71352024-08-28T04:10:37.572ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "963f77de-db0c-4d2b-9f32-ede91c2750a9", "content-length": "2", "date": "Wed, 28 Aug 2024 04:10:36 GMT"} })
71362024-08-28T04:10:37.572ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
71372024-08-28T04:10:37.572ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fea1bb85-a05e-47cd-a98c-aea2f8d4631d", "content-length": "50", "date": "Wed, 28 Aug 2024 04:10:36 GMT"} })
71382024-08-28T04:10:37.572ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
71392024-08-28T04:10:37.572ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
71402024-08-28T04:10:37.578ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
71412024-08-28T04:10:37.578ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4b747939-586b-48cb-a488-7f7f972db309, kind: Service { id: 4eb364e4-14a2-46c4-b173-eb2890920e8f }, name: Name("external-dns-4eb364e4-14a2-46c4-b173-eb2890920e8f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 113])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a3e0f17f-d79d-4cc0-ba0f-997e844ad5f3, kind: Service { id: 94b35d7a-af71-4078-a57c-874ff9a27068 }, name: Name("external-dns-94b35d7a-af71-4078-a57c-874ff9a27068"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 179])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0cddb53a-efd3-4f89-93d7-81b182af0cdb, kind: Service { id: 1c6ee351-cab6-4c23-8658-c31bac40b40a }, name: Name("nexus-1c6ee351-cab6-4c23-8658-c31bac40b40a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 245])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1a83b6d1-627c-41ca-8268-a29f26800e91, kind: Service { id: 4c8a8ded-ced6-466f-8626-7fd39c37d020 }, name: Name("nexus-4c8a8ded-ced6-466f-8626-7fd39c37d020"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 34a49c6e-26fe-4abd-8702-695d279dbdca, kind: Service { id: bda2ed8e-2ea5-41eb-824b-d14527b76b8b }, name: Name("nexus-bda2ed8e-2ea5-41eb-824b-d14527b76b8b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
71422024-08-28T04:10:37.578ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
71432024-08-28T04:10:37.647ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, time_created: 2024-08-28T04:05:44.270073Z, time_modified: 2024-08-28T04:05:44.270073Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
71442024-08-28T04:10:37.647ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
71452024-08-28T04:10:37.647ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71462024-08-28T04:10:37.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71472024-08-28T04:10:37.650ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71482024-08-28T04:10:37.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71492024-08-28T04:10:37.651ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71502024-08-28T04:10:37.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
71512024-08-28T04:10:37.688ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
71522024-08-28T04:10:37.688ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "60f344d9-489f-4947-8226-b7cce8745162", "date": "Wed, 28 Aug 2024 04:10:37 GMT"} })
71532024-08-28T04:10:37.689ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
71542024-08-28T04:10:37.689ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 629.677685ms
71552024-08-28T04:10:37.689ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 629.688246ms iteration = 2 status = {}
71562024-08-28T04:10:37.768ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f53bcedb-832d-4ae9-8adc-60fbe1a377f6", "date": "Wed, 28 Aug 2024 04:10:37 GMT"} })
71572024-08-28T04:10:37.768ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch = Switch0
71582024-08-28T04:10:37.768ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
71592024-08-28T04:10:37.769ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "91393d9c-8c9f-475a-ba77-f622520b8682", "content-length": "667", "date": "Wed, 28 Aug 2024 04:10:37 GMT"} })
71602024-08-28T04:10:37.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71612024-08-28T04:10:37.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71622024-08-28T04:10:37.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71632024-08-28T04:10:37.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71642024-08-28T04:10:37.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71652024-08-28T04:10:37.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71662024-08-28T04:10:37.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71672024-08-28T04:10:37.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71682024-08-28T04:10:37.783ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 723.399818ms iteration = 11 status = {}
71692024-08-28T04:10:39.059ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:33439
71702024-08-28T04:10:39.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33439 req_id = a229b6c7-7ca4-4c67-9c35-9847a2f50142 roles = RoleSet { roles: {} } uri = /metrics/producers
71712024-08-28T04:10:39.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33439 req_id = a229b6c7-7ca4-4c67-9c35-9847a2f50142 resource = Database result = Ok(()) uri = /metrics/producers
71722024-08-28T04:10:39.091ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
71732024-08-28T04:10:39.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33439 req_id = a229b6c7-7ca4-4c67-9c35-9847a2f50142 roles = RoleSet { roles: {} } uri = /metrics/producers
71742024-08-28T04:10:39.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33439 req_id = a229b6c7-7ca4-4c67-9c35-9847a2f50142 resource = Database result = Ok(()) uri = /metrics/producers
71752024-08-28T04:10:39.098ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
71762024-08-28T04:10:39.099ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "acef61c6-b242-4f66-8a36-3c2fce542372", "date": "Wed, 28 Aug 2024 04:10:39 GMT"} })
71772024-08-28T04:10:39.099ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 84f8f69b-1de3-4c63-8327-f221abc8d62f
71782024-08-28T04:10:39.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40947 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33439 req_id = a229b6c7-7ca4-4c67-9c35-9847a2f50142 response_code = 201 uri = /metrics/producers
71792024-08-28T04:10:41.172ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1209 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = f585c3c3-ff6c-4a2d-ae25-69497286a565 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
71802024-08-28T04:10:47.059ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
71812024-08-28T04:10:47.060ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
71822024-08-28T04:10:47.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71832024-08-28T04:10:47.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71842024-08-28T04:10:47.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71852024-08-28T04:10:47.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71862024-08-28T04:10:47.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71872024-08-28T04:10:47.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71882024-08-28T04:10:47.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71892024-08-28T04:10:47.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.451711ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71902024-08-28T04:10:47.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71912024-08-28T04:10:47.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71922024-08-28T04:10:47.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71932024-08-28T04:10:47.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71942024-08-28T04:10:47.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71952024-08-28T04:10:47.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71962024-08-28T04:10:47.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
71972024-08-28T04:10:47.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71982024-08-28T04:10:47.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71992024-08-28T04:10:47.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
72002024-08-28T04:10:47.079ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.693918ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
72012024-08-28T04:10:51.173ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = c98d69a2-3f44-4463-86ee-ed8e68d8e3fb response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
72022024-08-28T04:10:51.173ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
72032024-08-28T04:10:51.173ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
72042024-08-28T04:10:51.203ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
72052024-08-28T04:10:51.203ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:56157
72062024-08-28T04:10:51.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56157 req_id = 6e213048-11c5-4e07-b8d7-2a8fcab58c9f roles = RoleSet { roles: {} } uri = /metrics/producers
72072024-08-28T04:10:51.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56157 req_id = 6e213048-11c5-4e07-b8d7-2a8fcab58c9f resource = Database result = Ok(()) uri = /metrics/producers
72082024-08-28T04:10:51.240ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
72092024-08-28T04:10:51.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56157 req_id = 6e213048-11c5-4e07-b8d7-2a8fcab58c9f roles = RoleSet { roles: {} } uri = /metrics/producers
72102024-08-28T04:10:51.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56157 req_id = 6e213048-11c5-4e07-b8d7-2a8fcab58c9f resource = Database result = Ok(()) uri = /metrics/producers
72112024-08-28T04:10:51.270ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
72122024-08-28T04:10:51.271ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "60d2a1f0-5980-4054-9c22-a261cff09f69", "date": "Wed, 28 Aug 2024 04:10:51 GMT"} })
72132024-08-28T04:10:51.271ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
72142024-08-28T04:10:51.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 69356 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56157 req_id = 6e213048-11c5-4e07-b8d7-2a8fcab58c9f response_code = 201 uri = /metrics/producers
72152024-08-28T04:10:51.272ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "6e213048-11c5-4e07-b8d7-2a8fcab58c9f", "content-length": "41", "date": "Wed, 28 Aug 2024 04:10:51 GMT"} })
72162024-08-28T04:10:51.273ZDEBGnexus (producer-registration-task): registered with nexus successfully
72172024-08-28T04:10:51.273ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
72182024-08-28T04:10:57.059ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
72192024-08-28T04:10:57.059ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
72202024-08-28T04:10:57.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72212024-08-28T04:10:57.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72222024-08-28T04:10:57.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72232024-08-28T04:10:57.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72242024-08-28T04:10:57.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72252024-08-28T04:10:57.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72262024-08-28T04:10:57.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72272024-08-28T04:10:57.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.397679ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72282024-08-28T04:10:57.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72292024-08-28T04:10:57.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72302024-08-28T04:10:57.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72312024-08-28T04:10:57.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72322024-08-28T04:10:57.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72332024-08-28T04:10:57.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72342024-08-28T04:10:57.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
72352024-08-28T04:10:57.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72362024-08-28T04:10:57.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72372024-08-28T04:10:57.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
72382024-08-28T04:10:57.079ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.589175ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
72392024-08-28T04:11:01.272ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1208 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = bd93e6ec-ab9c-43fc-b883-87c6c27a9ea8 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
72402024-08-28T04:11:07.059ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
72412024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
72422024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
72432024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72442024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
72452024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
72462024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
72472024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72482024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
72492024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72502024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
72512024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72522024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72532024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
72542024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
72552024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
72562024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
72572024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72582024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72592024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
72602024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72612024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
72622024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
72632024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
72642024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72652024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
72662024-08-28T04:11:07.060ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
72672024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72682024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
72692024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72702024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
72712024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72722024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72732024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
72742024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72752024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
72762024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72772024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72782024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72792024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72802024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72812024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72822024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72832024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72842024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72852024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72862024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72872024-08-28T04:11:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72882024-08-28T04:11:07.063ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1354, tv_nsec: 147859046 } })
72892024-08-28T04:11:07.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72902024-08-28T04:11:07.064ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
72912024-08-28T04:11:07.065ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.283595ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
72922024-08-28T04:11:07.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72932024-08-28T04:11:07.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.688946ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
72942024-08-28T04:11:07.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72952024-08-28T04:11:07.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72962024-08-28T04:11:07.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72972024-08-28T04:11:07.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72982024-08-28T04:11:07.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72992024-08-28T04:11:07.070ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73002024-08-28T04:11:07.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73012024-08-28T04:11:07.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73022024-08-28T04:11:07.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73032024-08-28T04:11:07.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73042024-08-28T04:11:07.072ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73052024-08-28T04:11:07.072ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1354, tv_nsec: 156855990 } })
73062024-08-28T04:11:07.073ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73072024-08-28T04:11:07.074ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
73082024-08-28T04:11:07.074ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73092024-08-28T04:11:07.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73102024-08-28T04:11:07.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73112024-08-28T04:11:07.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
73122024-08-28T04:11:07.074ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73132024-08-28T04:11:07.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73142024-08-28T04:11:07.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73152024-08-28T04:11:07.076ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73162024-08-28T04:11:07.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73172024-08-28T04:11:07.078ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73182024-08-28T04:11:07.078ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1354, tv_nsec: 162780244 } })
73192024-08-28T04:11:07.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73202024-08-28T04:11:07.078ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
73212024-08-28T04:11:07.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73222024-08-28T04:11:07.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73232024-08-28T04:11:07.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73242024-08-28T04:11:07.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73252024-08-28T04:11:07.079ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73262024-08-28T04:11:07.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73272024-08-28T04:11:07.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73282024-08-28T04:11:07.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73292024-08-28T04:11:07.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73302024-08-28T04:11:07.081ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.712878ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73312024-08-28T04:11:07.082ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73322024-08-28T04:11:07.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73332024-08-28T04:11:07.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73342024-08-28T04:11:07.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73352024-08-28T04:11:07.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73362024-08-28T04:11:07.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73372024-08-28T04:11:07.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73382024-08-28T04:11:07.086ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73392024-08-28T04:11:07.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73402024-08-28T04:11:07.088ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73412024-08-28T04:11:07.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73422024-08-28T04:11:07.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
73432024-08-28T04:11:07.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73442024-08-28T04:11:07.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73452024-08-28T04:11:07.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73462024-08-28T04:11:07.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73472024-08-28T04:11:07.110ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
73482024-08-28T04:11:07.110ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
73492024-08-28T04:11:07.110ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73502024-08-28T04:11:07.110ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
73512024-08-28T04:11:07.110ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.618257ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
73522024-08-28T04:11:07.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73532024-08-28T04:11:07.117ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73542024-08-28T04:11:07.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73552024-08-28T04:11:07.120ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73562024-08-28T04:11:07.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73572024-08-28T04:11:07.128ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73582024-08-28T04:11:07.128ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73592024-08-28T04:11:07.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73602024-08-28T04:11:07.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73612024-08-28T04:11:07.130ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73622024-08-28T04:11:07.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
73632024-08-28T04:11:07.133ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73642024-08-28T04:11:07.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73652024-08-28T04:11:07.135ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 75.450736ms iteration = 12 status = 0
73662024-08-28T04:11:07.149ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.85233ms iteration = 12 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
73672024-08-28T04:11:07.154ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 94.425764ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
73682024-08-28T04:11:07.155ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 95.35381ms iteration = 14 status = {"physical_disks_added":0}
73692024-08-28T04:11:07.156ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
73702024-08-28T04:11:07.156ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73712024-08-28T04:11:07.156ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "75ba28ad-a655-45ea-86f4-52c5e9a1d32c", "content-length": "26", "date": "Wed, 28 Aug 2024 04:11:07 GMT"} })
73722024-08-28T04:11:07.156ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73732024-08-28T04:11:07.156ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
73742024-08-28T04:11:07.156ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
73752024-08-28T04:11:07.156ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 96.493335ms iteration = 12 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
73762024-08-28T04:11:07.157ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73772024-08-28T04:11:07.159ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
73782024-08-28T04:11:07.159ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 99.584575ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
73792024-08-28T04:11:07.161ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
73802024-08-28T04:11:07.161ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73812024-08-28T04:11:07.162ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "92deb6e8-c8f7-4fcf-b7a8-1ae3d3a9a93e", "content-length": "26", "date": "Wed, 28 Aug 2024 04:11:07 GMT"} })
73822024-08-28T04:11:07.162ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73832024-08-28T04:11:07.164ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73842024-08-28T04:11:07.169ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
73852024-08-28T04:11:07.169ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 109.473556ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
73862024-08-28T04:11:07.175ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 zone_address = fd00:1122:3344:101::2
73872024-08-28T04:11:07.175ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73882024-08-28T04:11:07.175ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9e389b82-1a6f-4892-881a-9c234e5d1f03", "content-length": "26", "date": "Wed, 28 Aug 2024 04:11:07 GMT"} })
73892024-08-28T04:11:07.175ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73902024-08-28T04:11:07.177ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
73912024-08-28T04:11:07.200ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73922024-08-28T04:11:07.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73932024-08-28T04:11:07.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73942024-08-28T04:11:07.204ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73952024-08-28T04:11:07.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73962024-08-28T04:11:07.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73972024-08-28T04:11:07.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73982024-08-28T04:11:07.208ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73992024-08-28T04:11:07.208ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74002024-08-28T04:11:07.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74012024-08-28T04:11:07.302ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 242.196844ms iteration = 12 status = {}
74022024-08-28T04:11:07.351ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
74032024-08-28T04:11:07.353ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2c2877a7-71e8-4b8a-9c7c-3b74c777f0b7", "content-length": "691", "date": "Wed, 28 Aug 2024 04:11:06 GMT"} })
74042024-08-28T04:11:07.353ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
74052024-08-28T04:11:07.353ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
74062024-08-28T04:11:07.353ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
74072024-08-28T04:11:07.355ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 295.222952ms iteration = 12 status = {}
74082024-08-28T04:11:07.411ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
74092024-08-28T04:11:07.411ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "71e9c9e9-218b-4014-a323-49d7d8ba1dc0", "content-length": "1", "date": "Wed, 28 Aug 2024 04:11:06 GMT"} })
74102024-08-28T04:11:07.412ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74112024-08-28T04:11:07.412ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2481d6f7-191f-4898-a373-5a7a3ee14403", "content-length": "372", "date": "Wed, 28 Aug 2024 04:11:06 GMT"} })
74122024-08-28T04:11:07.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74132024-08-28T04:11:07.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74142024-08-28T04:11:07.414ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74152024-08-28T04:11:07.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74162024-08-28T04:11:07.415ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74172024-08-28T04:11:07.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74182024-08-28T04:11:07.416ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 356.277936ms iteration = 12 status = null
74192024-08-28T04:11:07.418ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74202024-08-28T04:11:07.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74212024-08-28T04:11:07.422ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74222024-08-28T04:11:07.423ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9da7621c-feca-43d9-aee3-3f685ebbd06d", "date": "Wed, 28 Aug 2024 04:11:06 GMT"} })
74232024-08-28T04:11:07.424ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 364.848517ms iteration = 13 status = {}
74242024-08-28T04:11:07.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74252024-08-28T04:11:07.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74262024-08-28T04:11:07.453ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 21872882-9c7e-4a12-8d80-3d3b1686a012, rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(726f0c10-a692-46cf-962b-4ac9a2a107fc) } rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
74272024-08-28T04:11:07.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74282024-08-28T04:11:07.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74292024-08-28T04:11:07.463ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
74302024-08-28T04:11:07.464ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ef8458a8-b638-4264-9c16-2c569f3004ba", "content-length": "121", "date": "Wed, 28 Aug 2024 04:11:06 GMT"} })
74312024-08-28T04:11:07.464ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
74322024-08-28T04:11:07.464ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 726f0c10-a692-46cf-962b-4ac9a2a107fc
74332024-08-28T04:11:07.464ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
74342024-08-28T04:11:07.464ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
74352024-08-28T04:11:07.464ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
74362024-08-28T04:11:07.464ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
74372024-08-28T04:11:07.464ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
74382024-08-28T04:11:07.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74392024-08-28T04:11:07.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74402024-08-28T04:11:07.466ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
74412024-08-28T04:11:07.466ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "21c4a0ec-c041-458b-bbcb-d9e0b901b417", "content-length": "2", "date": "Wed, 28 Aug 2024 04:11:06 GMT"} })
74422024-08-28T04:11:07.466ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
74432024-08-28T04:11:07.467ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "df2411d4-311d-4e58-a8b9-042c33362bbc", "content-length": "50", "date": "Wed, 28 Aug 2024 04:11:06 GMT"} })
74442024-08-28T04:11:07.467ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
74452024-08-28T04:11:07.467ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
74462024-08-28T04:11:07.655ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0df08b98-7e49-4983-a0c1-7d9eefb57b93", "date": "Wed, 28 Aug 2024 04:11:06 GMT"} })
74472024-08-28T04:11:07.656ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch = Switch0
74482024-08-28T04:11:07.656ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
74492024-08-28T04:11:07.656ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6fe64949-64ee-460e-9868-40a1ada41794", "content-length": "667", "date": "Wed, 28 Aug 2024 04:11:07 GMT"} })
74502024-08-28T04:11:07.657ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74512024-08-28T04:11:07.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74522024-08-28T04:11:07.660ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74532024-08-28T04:11:07.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74542024-08-28T04:11:07.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74552024-08-28T04:11:07.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74562024-08-28T04:11:07.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74572024-08-28T04:11:07.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74582024-08-28T04:11:07.672ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 612.518131ms iteration = 12 status = {}
74592024-08-28T04:11:11.273ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1374 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = ee22ddf3-267c-4e3c-a872-36ebfb5303c8 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
74602024-08-28T04:11:17.059ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
74612024-08-28T04:11:17.059ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
74622024-08-28T04:11:17.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74632024-08-28T04:11:17.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74642024-08-28T04:11:17.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74652024-08-28T04:11:17.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74662024-08-28T04:11:17.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74672024-08-28T04:11:17.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74682024-08-28T04:11:17.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74692024-08-28T04:11:17.063ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.953926ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74702024-08-28T04:11:17.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74712024-08-28T04:11:17.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74722024-08-28T04:11:17.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74732024-08-28T04:11:17.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74742024-08-28T04:11:17.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74752024-08-28T04:11:17.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74762024-08-28T04:11:17.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
74772024-08-28T04:11:17.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74782024-08-28T04:11:17.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74792024-08-28T04:11:17.073ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
74802024-08-28T04:11:17.073ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.500385ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
74812024-08-28T04:11:21.272ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1332 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 0a36f2c9-14dc-4d04-815b-cf5893aac4de response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
74822024-08-28T04:11:22.422ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:46872
74832024-08-28T04:11:22.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46872 req_id = a3cb1da0-3966-4932-a23d-98349f9d551b roles = RoleSet { roles: {} } uri = /metrics/producers
74842024-08-28T04:11:22.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46872 req_id = a3cb1da0-3966-4932-a23d-98349f9d551b resource = Database result = Ok(()) uri = /metrics/producers
74852024-08-28T04:11:22.455ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
74862024-08-28T04:11:22.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46872 req_id = a3cb1da0-3966-4932-a23d-98349f9d551b roles = RoleSet { roles: {} } uri = /metrics/producers
74872024-08-28T04:11:22.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46872 req_id = a3cb1da0-3966-4932-a23d-98349f9d551b resource = Database result = Ok(()) uri = /metrics/producers
74882024-08-28T04:11:22.483ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
74892024-08-28T04:11:22.484ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1efcaed7-5436-4e78-b1dc-300ac8b08f3f", "date": "Wed, 28 Aug 2024 04:11:22 GMT"} })
74902024-08-28T04:11:22.484ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 3cb8c6a9-56d6-4181-bb25-feecc98b4c4e
74912024-08-28T04:11:22.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 63920 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46872 req_id = a3cb1da0-3966-4932-a23d-98349f9d551b response_code = 201 uri = /metrics/producers
74922024-08-28T04:11:27.059ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
74932024-08-28T04:11:27.059ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
74942024-08-28T04:11:27.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74952024-08-28T04:11:27.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74962024-08-28T04:11:27.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74972024-08-28T04:11:27.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74982024-08-28T04:11:27.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74992024-08-28T04:11:27.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75002024-08-28T04:11:27.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75012024-08-28T04:11:27.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.778941ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75022024-08-28T04:11:27.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75032024-08-28T04:11:27.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75042024-08-28T04:11:27.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75052024-08-28T04:11:27.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75062024-08-28T04:11:27.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75072024-08-28T04:11:27.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75082024-08-28T04:11:27.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
75092024-08-28T04:11:27.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75102024-08-28T04:11:27.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75112024-08-28T04:11:27.078ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
75122024-08-28T04:11:27.078ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.174264ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
75132024-08-28T04:11:31.273ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1332 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 02b6652d-5595-443a-a8ee-34c4822ad0f9 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
75142024-08-28T04:11:37.058ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
75152024-08-28T04:11:37.058ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
75162024-08-28T04:11:37.058ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
75172024-08-28T04:11:37.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75182024-08-28T04:11:37.058ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75192024-08-28T04:11:37.058ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
75202024-08-28T04:11:37.058ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
75212024-08-28T04:11:37.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75222024-08-28T04:11:37.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75232024-08-28T04:11:37.058ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
75242024-08-28T04:11:37.058ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
75252024-08-28T04:11:37.058ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
75262024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
75272024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75282024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75292024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
75302024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75312024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
75322024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75332024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
75342024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75352024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
75362024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75372024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
75382024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
75392024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75402024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
75412024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
75422024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75432024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
75442024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
75452024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75462024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
75472024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
75482024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
75492024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
75502024-08-28T04:11:37.059ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764
75512024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.35\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764"}
75522024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
75532024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
75542024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
75552024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
75562024-08-28T04:11:37.059ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
75572024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
75582024-08-28T04:11:37.059ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
75592024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75602024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
75612024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
75622024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
75632024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75642024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
75652024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
75662024-08-28T04:11:37.059ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
75672024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75682024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75692024-08-28T04:11:37.059ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 04:01:37.059215189 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
75702024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
75712024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
75722024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75732024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
75742024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75752024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75762024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75772024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75782024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75792024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75802024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75812024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
75822024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75832024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75842024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75852024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75862024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75872024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75882024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75892024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75902024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
75912024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75922024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75932024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75942024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75952024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75962024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
75972024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
75982024-08-28T04:11:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
75992024-08-28T04:11:37.059ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4eb364e4-14a2-46c4-b173-eb2890920e8f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 144550889 } })
76002024-08-28T04:11:37.059ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("037b07ce-9e39-4982-8c20-c4c38f448b97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4e2ba65e-422a-4b1e-b0e3-85f8149a979a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 144586910 } })
76012024-08-28T04:11:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76022024-08-28T04:11:37.060ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76032024-08-28T04:11:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76042024-08-28T04:11:37.060ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76052024-08-28T04:11:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76062024-08-28T04:11:37.060ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76072024-08-28T04:11:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76082024-08-28T04:11:37.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76092024-08-28T04:11:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76102024-08-28T04:11:37.063ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
76112024-08-28T04:11:37.063ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.453351ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
76122024-08-28T04:11:37.063ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
76132024-08-28T04:11:37.063ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.723468ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
76142024-08-28T04:11:37.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76152024-08-28T04:11:37.064ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76162024-08-28T04:11:37.064ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76172024-08-28T04:11:37.064ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.750949ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
76182024-08-28T04:11:37.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76192024-08-28T04:11:37.065ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76202024-08-28T04:11:37.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
76212024-08-28T04:11:37.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76222024-08-28T04:11:37.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76232024-08-28T04:11:37.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76242024-08-28T04:11:37.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76252024-08-28T04:11:37.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76262024-08-28T04:11:37.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76272024-08-28T04:11:37.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76282024-08-28T04:11:37.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76292024-08-28T04:11:37.073ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76302024-08-28T04:11:37.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76312024-08-28T04:11:37.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76322024-08-28T04:11:37.078ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76332024-08-28T04:11:37.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76342024-08-28T04:11:37.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76352024-08-28T04:11:37.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76362024-08-28T04:11:37.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76372024-08-28T04:11:37.086ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76382024-08-28T04:11:37.086ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76392024-08-28T04:11:37.088ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 29.773005ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
76402024-08-28T04:11:37.089ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
76412024-08-28T04:11:37.090ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76422024-08-28T04:11:37.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76432024-08-28T04:11:37.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
76442024-08-28T04:11:37.090ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
76452024-08-28T04:11:37.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76462024-08-28T04:11:37.092ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76472024-08-28T04:11:37.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76482024-08-28T04:11:37.094ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 178690962 } })
76492024-08-28T04:11:37.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76502024-08-28T04:11:37.096ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76512024-08-28T04:11:37.096ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
76522024-08-28T04:11:37.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76532024-08-28T04:11:37.096ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 181613248 } })
76542024-08-28T04:11:37.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
76552024-08-28T04:11:37.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76562024-08-28T04:11:37.097ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76572024-08-28T04:11:37.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76582024-08-28T04:11:37.099ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 04:01:37.059215189 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
76592024-08-28T04:11:37.099ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 40.480309ms iteration = 7 status = {"expiration":"2024-08-28T04:01:37.059215189Z","pruned":[]}
76602024-08-28T04:11:37.099ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76612024-08-28T04:11:37.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76622024-08-28T04:11:37.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76632024-08-28T04:11:37.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76642024-08-28T04:11:37.103ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76652024-08-28T04:11:37.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76662024-08-28T04:11:37.103ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76672024-08-28T04:11:37.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76682024-08-28T04:11:37.106ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76692024-08-28T04:11:37.106ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76702024-08-28T04:11:37.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76712024-08-28T04:11:37.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76722024-08-28T04:11:37.106ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76732024-08-28T04:11:37.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76742024-08-28T04:11:37.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76752024-08-28T04:11:37.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76762024-08-28T04:11:37.108ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76772024-08-28T04:11:37.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76782024-08-28T04:11:37.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76792024-08-28T04:11:37.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76802024-08-28T04:11:37.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76812024-08-28T04:11:37.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76822024-08-28T04:11:37.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76832024-08-28T04:11:37.113ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 198157803 } })
76842024-08-28T04:11:37.114ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
76852024-08-28T04:11:37.114ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76862024-08-28T04:11:37.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76872024-08-28T04:11:37.115ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
76882024-08-28T04:11:37.115ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.830849ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
76892024-08-28T04:11:37.116ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76902024-08-28T04:11:37.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76912024-08-28T04:11:37.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76922024-08-28T04:11:37.116ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76932024-08-28T04:11:37.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76942024-08-28T04:11:37.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76952024-08-28T04:11:37.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
76962024-08-28T04:11:37.123ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76972024-08-28T04:11:37.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76982024-08-28T04:11:37.123ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.502315ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
76992024-08-28T04:11:37.124ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77002024-08-28T04:11:37.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
77012024-08-28T04:11:37.128ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77022024-08-28T04:11:37.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77032024-08-28T04:11:37.130ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77042024-08-28T04:11:37.130ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77052024-08-28T04:11:37.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77062024-08-28T04:11:37.131ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77072024-08-28T04:11:37.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77082024-08-28T04:11:37.132ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77092024-08-28T04:11:37.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77102024-08-28T04:11:37.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77112024-08-28T04:11:37.133ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77122024-08-28T04:11:37.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77132024-08-28T04:11:37.133ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77142024-08-28T04:11:37.135ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77152024-08-28T04:11:37.135ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77162024-08-28T04:11:37.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77172024-08-28T04:11:37.136ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77182024-08-28T04:11:37.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77192024-08-28T04:11:37.138ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
77202024-08-28T04:11:37.138ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
77212024-08-28T04:11:37.138ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77222024-08-28T04:11:37.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77232024-08-28T04:11:37.140ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
77242024-08-28T04:11:37.140ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
77252024-08-28T04:11:37.140ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 81.793982ms iteration = 7 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
77262024-08-28T04:11:37.140ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77272024-08-28T04:11:37.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77282024-08-28T04:11:37.142ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.856044ms iteration = 13 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
77292024-08-28T04:11:37.146ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77302024-08-28T04:11:37.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77312024-08-28T04:11:37.150ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77322024-08-28T04:11:37.151ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77332024-08-28T04:11:37.151ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77342024-08-28T04:11:37.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77352024-08-28T04:11:37.153ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77362024-08-28T04:11:37.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77372024-08-28T04:11:37.153ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77382024-08-28T04:11:37.153ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77392024-08-28T04:11:37.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77402024-08-28T04:11:37.154ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
77412024-08-28T04:11:37.154ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77422024-08-28T04:11:37.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77432024-08-28T04:11:37.155ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 96.460224ms iteration = 4 status = {"nsuccess":5}
77442024-08-28T04:11:37.156ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
77452024-08-28T04:11:37.156ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 97.348359ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
77462024-08-28T04:11:37.162ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
77472024-08-28T04:11:37.162ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
77482024-08-28T04:11:37.162ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
77492024-08-28T04:11:37.162ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77502024-08-28T04:11:37.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77512024-08-28T04:11:37.163ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
77522024-08-28T04:11:37.163ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
77532024-08-28T04:11:37.163ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 104.211582ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
77542024-08-28T04:11:37.165ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77552024-08-28T04:11:37.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77562024-08-28T04:11:37.165ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77572024-08-28T04:11:37.168ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77582024-08-28T04:11:37.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77592024-08-28T04:11:37.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77602024-08-28T04:11:37.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77612024-08-28T04:11:37.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77622024-08-28T04:11:37.169ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
77632024-08-28T04:11:37.169ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
77642024-08-28T04:11:37.169ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
77652024-08-28T04:11:37.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77662024-08-28T04:11:37.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77672024-08-28T04:11:37.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77682024-08-28T04:11:37.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77692024-08-28T04:11:37.175ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77702024-08-28T04:11:37.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77712024-08-28T04:11:37.182ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 123.790076ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
77722024-08-28T04:11:37.185ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77732024-08-28T04:11:37.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77742024-08-28T04:11:37.192ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
77752024-08-28T04:11:37.192ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77762024-08-28T04:11:37.192ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 133.79257ms iteration = 13 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
77772024-08-28T04:11:37.197ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 138.348984ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77782024-08-28T04:11:37.197ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
77792024-08-28T04:11:37.200ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T04:05:35.065116Z, time_modified: 2024-08-28T04:05:35.065116Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }) }
77802024-08-28T04:11:37.200ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 141.814726ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]}},"default_endpoint":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
77812024-08-28T04:11:37.202ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
77822024-08-28T04:11:37.207ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 148.11044ms iteration = 15 status = {"physical_disks_added":0}
77832024-08-28T04:11:37.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77842024-08-28T04:11:37.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
77852024-08-28T04:11:37.218ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77862024-08-28T04:11:37.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77872024-08-28T04:11:37.220ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
77882024-08-28T04:11:37.220ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
77892024-08-28T04:11:37.220ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77902024-08-28T04:11:37.220ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 161.649348ms iteration = 13 status = 0
77912024-08-28T04:11:37.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77922024-08-28T04:11:37.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77932024-08-28T04:11:37.222ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
77942024-08-28T04:11:37.222ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 0 version = 2
77952024-08-28T04:11:37.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77962024-08-28T04:11:37.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77972024-08-28T04:11:37.224ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77982024-08-28T04:11:37.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77992024-08-28T04:11:37.224ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78002024-08-28T04:11:37.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78012024-08-28T04:11:37.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78022024-08-28T04:11:37.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78032024-08-28T04:11:37.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78042024-08-28T04:11:37.229ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 1 version = 2
78052024-08-28T04:11:37.229ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
78062024-08-28T04:11:37.229ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 04:05:50.133665 UTC dns_group = external generation = 2
78072024-08-28T04:11:37.229ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 170.478977ms iteration = 8 status = {"generation":2}
78082024-08-28T04:11:37.230ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
78092024-08-28T04:11:37.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 171.208079ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
78102024-08-28T04:11:37.230ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
78112024-08-28T04:11:37.230ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
78122024-08-28T04:11:37.230ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 04:05:49.286960 UTC dns_group = internal generation = 1
78132024-08-28T04:11:37.230ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 171.815807ms iteration = 8 status = {"generation":1}
78142024-08-28T04:11:37.265ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
78152024-08-28T04:11:37.265ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78162024-08-28T04:11:37.265ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5ad28efe-246e-4adc-a866-d5811ad85bff", "content-length": "26", "date": "Wed, 28 Aug 2024 04:11:37 GMT"} })
78172024-08-28T04:11:37.265ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78182024-08-28T04:11:37.267ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78192024-08-28T04:11:37.270ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
78202024-08-28T04:11:37.270ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78212024-08-28T04:11:37.271ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b713546d-d79b-4de6-96fe-be5759abf0cc", "content-length": "26", "date": "Wed, 28 Aug 2024 04:11:37 GMT"} })
78222024-08-28T04:11:37.271ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78232024-08-28T04:11:37.273ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78242024-08-28T04:11:37.275ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 zone_address = fd00:1122:3344:101::2
78252024-08-28T04:11:37.275ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78262024-08-28T04:11:37.276ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "85e3db3a-d91b-4fc9-8c1b-9d00c952457a", "content-length": "26", "date": "Wed, 28 Aug 2024 04:11:37 GMT"} })
78272024-08-28T04:11:37.276ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78282024-08-28T04:11:37.277ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
78292024-08-28T04:11:37.314ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78302024-08-28T04:11:37.314ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "69b05cb4-dcf7-4f01-8978-07d9ca4725aa", "content-length": "372", "date": "Wed, 28 Aug 2024 04:11:36 GMT"} })
78312024-08-28T04:11:37.314ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78322024-08-28T04:11:37.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78332024-08-28T04:11:37.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78342024-08-28T04:11:37.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78352024-08-28T04:11:37.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78362024-08-28T04:11:37.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78372024-08-28T04:11:37.323ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78382024-08-28T04:11:37.324ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d392d6e2-7191-461b-a9fc-95c8ea4c5c0e", "date": "Wed, 28 Aug 2024 04:11:36 GMT"} })
78392024-08-28T04:11:37.326ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 267.296122ms iteration = 14 status = {}
78402024-08-28T04:11:37.377ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
78412024-08-28T04:11:37.377ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
78422024-08-28T04:11:37.377ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "31a23906-1503-4bc9-ba89-e222f6884eb4", "date": "Wed, 28 Aug 2024 04:11:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
78432024-08-28T04:11:37.377ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
78442024-08-28T04:11:37.379ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "67bff1c0-bae8-468f-9e4e-0c651aff9a78", "date": "Wed, 28 Aug 2024 04:11:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
78452024-08-28T04:11:37.379ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
78462024-08-28T04:11:37.380ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
78472024-08-28T04:11:37.380ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 321.861054ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
78482024-08-28T04:11:37.398ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
78492024-08-28T04:11:37.399ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "243f57eb-ec63-4e73-8ed3-6465a45bf00c", "content-length": "691", "date": "Wed, 28 Aug 2024 04:11:36 GMT"} })
78502024-08-28T04:11:37.399ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
78512024-08-28T04:11:37.399ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
78522024-08-28T04:11:37.399ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
78532024-08-28T04:11:37.401ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 342.449109ms iteration = 13 status = {}
78542024-08-28T04:11:37.485ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
78552024-08-28T04:11:37.487ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a157caf4-7ab6-48c7-a210-117b48d8c7c5", "date": "Wed, 28 Aug 2024 04:11:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
78562024-08-28T04:11:37.487ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
78572024-08-28T04:11:37.488ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "62f22939-2a61-4d2b-8e93-ef3f1e06dcf1", "date": "Wed, 28 Aug 2024 04:11:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
78582024-08-28T04:11:37.488ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
78592024-08-28T04:11:37.490ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6ae27027-bdd7-4f39-9256-e608d24b5fc9", "date": "Wed, 28 Aug 2024 04:11:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
78602024-08-28T04:11:37.490ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
78612024-08-28T04:11:37.492ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
78622024-08-28T04:11:37.492ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 433.396821ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
78632024-08-28T04:11:37.516ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 457.310423ms iteration = 13 status = {}
78642024-08-28T04:11:37.525ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78652024-08-28T04:11:37.525ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "01e22609-aeea-467a-97af-d0b98f8dd829", "content-length": "1", "date": "Wed, 28 Aug 2024 04:11:36 GMT"} })
78662024-08-28T04:11:37.526ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78672024-08-28T04:11:37.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78682024-08-28T04:11:37.529ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 470.171651ms iteration = 13 status = null
78692024-08-28T04:11:37.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78702024-08-28T04:11:37.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78712024-08-28T04:11:37.553ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 21872882-9c7e-4a12-8d80-3d3b1686a012, rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(726f0c10-a692-46cf-962b-4ac9a2a107fc) } rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
78722024-08-28T04:11:37.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78732024-08-28T04:11:37.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78742024-08-28T04:11:37.564ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
78752024-08-28T04:11:37.565ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "50d8a51e-9054-48d1-9a94-3f53a1bb1eed", "content-length": "121", "date": "Wed, 28 Aug 2024 04:11:36 GMT"} })
78762024-08-28T04:11:37.565ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
78772024-08-28T04:11:37.565ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 726f0c10-a692-46cf-962b-4ac9a2a107fc
78782024-08-28T04:11:37.565ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
78792024-08-28T04:11:37.565ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
78802024-08-28T04:11:37.565ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
78812024-08-28T04:11:37.565ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
78822024-08-28T04:11:37.565ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
78832024-08-28T04:11:37.565ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78842024-08-28T04:11:37.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78852024-08-28T04:11:37.568ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
78862024-08-28T04:11:37.568ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7af33f30-4c20-4410-91b6-75d8cd63761f", "content-length": "2", "date": "Wed, 28 Aug 2024 04:11:36 GMT"} })
78872024-08-28T04:11:37.568ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78882024-08-28T04:11:37.568ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6d386163-10e2-45da-ac25-53de6f290fa5", "content-length": "50", "date": "Wed, 28 Aug 2024 04:11:36 GMT"} })
78892024-08-28T04:11:37.568ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
78902024-08-28T04:11:37.568ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
78912024-08-28T04:11:37.691ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d2a764e0-8cb5-400c-a583-8d04229371d3", "date": "Wed, 28 Aug 2024 04:11:36 GMT"} })
78922024-08-28T04:11:37.691ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch = Switch0
78932024-08-28T04:11:37.691ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78942024-08-28T04:11:37.691ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5fbc02c8-7410-4fbb-92bc-95920e06b115", "content-length": "667", "date": "Wed, 28 Aug 2024 04:11:37 GMT"} })
78952024-08-28T04:11:37.691ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78962024-08-28T04:11:37.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78972024-08-28T04:11:37.695ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78982024-08-28T04:11:37.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78992024-08-28T04:11:37.699ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79002024-08-28T04:11:37.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79012024-08-28T04:11:37.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79022024-08-28T04:11:37.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79032024-08-28T04:11:37.708ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 649.786846ms iteration = 13 status = {}
79042024-08-28T04:11:41.272ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1331 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 5be93fb1-6b90-4a49-9d09-da8837681806 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
79052024-08-28T04:11:45.772ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:36393
79062024-08-28T04:11:45.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36393 req_id = 07023477-5613-48b9-ba59-7042d7badaf7 roles = RoleSet { roles: {} } uri = /metrics/producers
79072024-08-28T04:11:45.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36393 req_id = 07023477-5613-48b9-ba59-7042d7badaf7 resource = Database result = Ok(()) uri = /metrics/producers
79082024-08-28T04:11:45.807ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
79092024-08-28T04:11:45.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36393 req_id = 07023477-5613-48b9-ba59-7042d7badaf7 roles = RoleSet { roles: {} } uri = /metrics/producers
79102024-08-28T04:11:45.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36393 req_id = 07023477-5613-48b9-ba59-7042d7badaf7 resource = Database result = Ok(()) uri = /metrics/producers
79112024-08-28T04:11:45.836ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
79122024-08-28T04:11:45.837ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f81b0838-c722-4d6c-a554-ff117e4e5087", "date": "Wed, 28 Aug 2024 04:11:45 GMT"} })
79132024-08-28T04:11:45.837ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = e29f29d2-885c-4b33-aca8-4c86de0266cb
79142024-08-28T04:11:45.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 65449 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36393 req_id = 07023477-5613-48b9-ba59-7042d7badaf7 response_code = 201 uri = /metrics/producers
79152024-08-28T04:11:47.058ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
79162024-08-28T04:11:47.058ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
79172024-08-28T04:11:47.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79182024-08-28T04:11:47.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79192024-08-28T04:11:47.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79202024-08-28T04:11:47.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79212024-08-28T04:11:47.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79222024-08-28T04:11:47.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79232024-08-28T04:11:47.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79242024-08-28T04:11:47.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79252024-08-28T04:11:47.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79262024-08-28T04:11:47.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79272024-08-28T04:11:47.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79282024-08-28T04:11:47.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79292024-08-28T04:11:47.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79302024-08-28T04:11:47.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
79312024-08-28T04:11:47.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79322024-08-28T04:11:47.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79332024-08-28T04:11:47.077ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
79342024-08-28T04:11:47.077ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.811122ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
79352024-08-28T04:11:47.084ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.559851ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79362024-08-28T04:11:51.272ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1212 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 7851ca97-13e5-4f4c-aa90-cc45641971d9 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
79372024-08-28T04:11:57.059ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
79382024-08-28T04:11:57.059ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
79392024-08-28T04:11:57.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79402024-08-28T04:11:57.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79412024-08-28T04:11:57.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79422024-08-28T04:11:57.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79432024-08-28T04:11:57.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79442024-08-28T04:11:57.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79452024-08-28T04:11:57.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79462024-08-28T04:11:57.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.210374ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79472024-08-28T04:11:57.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79482024-08-28T04:11:57.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79492024-08-28T04:11:57.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79502024-08-28T04:11:57.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79512024-08-28T04:11:57.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79522024-08-28T04:11:57.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79532024-08-28T04:11:57.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
79542024-08-28T04:11:57.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79552024-08-28T04:11:57.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79562024-08-28T04:11:57.076ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
79572024-08-28T04:11:57.076ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.908467ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
79582024-08-28T04:12:01.273ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1708 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 7de17ec5-f6b8-43f9-9fd8-3d0670e09383 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
79592024-08-28T04:12:03.841ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:34761
79602024-08-28T04:12:03.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34761 req_id = c8cf5a2b-f5ca-4b30-a65e-ed7ddede3826 roles = RoleSet { roles: {} } uri = /metrics/producers
79612024-08-28T04:12:03.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34761 req_id = c8cf5a2b-f5ca-4b30-a65e-ed7ddede3826 resource = Database result = Ok(()) uri = /metrics/producers
79622024-08-28T04:12:03.905ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
79632024-08-28T04:12:03.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34761 req_id = c8cf5a2b-f5ca-4b30-a65e-ed7ddede3826 roles = RoleSet { roles: {} } uri = /metrics/producers
79642024-08-28T04:12:03.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34761 req_id = c8cf5a2b-f5ca-4b30-a65e-ed7ddede3826 resource = Database result = Ok(()) uri = /metrics/producers
79652024-08-28T04:12:04.283ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
79662024-08-28T04:12:04.283ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ef3a2975-b749-46b4-b016-0ff88a3ca52a", "date": "Wed, 28 Aug 2024 04:12:04 GMT"} })
79672024-08-28T04:12:04.283ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 0e1d8d78-006e-4d11-afc1-f62f97ae2dc4
79682024-08-28T04:12:04.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 444826 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34761 req_id = c8cf5a2b-f5ca-4b30-a65e-ed7ddede3826 response_code = 201 uri = /metrics/producers
79692024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
79702024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
79712024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79722024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79732024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
79742024-08-28T04:12:07.059ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
79752024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
79762024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79772024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79782024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
79792024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
79802024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79812024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79822024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
79832024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79842024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
79852024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79862024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
79872024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
79882024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
79892024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79902024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
79912024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
79922024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
79932024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
79942024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79952024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
79962024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
79972024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79982024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
79992024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80002024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
80012024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80022024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80032024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80042024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80052024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80062024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80072024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80082024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80092024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80102024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80112024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
80122024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80132024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
80142024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80152024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80162024-08-28T04:12:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80172024-08-28T04:12:07.063ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80182024-08-28T04:12:07.063ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80192024-08-28T04:12:07.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80202024-08-28T04:12:07.065ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80212024-08-28T04:12:07.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
80222024-08-28T04:12:07.065ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80232024-08-28T04:12:07.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80242024-08-28T04:12:07.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80252024-08-28T04:12:07.122ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80262024-08-28T04:12:07.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80272024-08-28T04:12:07.122ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 63.370821ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80282024-08-28T04:12:07.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80292024-08-28T04:12:07.124ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80302024-08-28T04:12:07.125ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1414, tv_nsec: 210728123 } })
80312024-08-28T04:12:07.126ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
80322024-08-28T04:12:07.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80332024-08-28T04:12:07.128ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80342024-08-28T04:12:07.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80352024-08-28T04:12:07.128ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80362024-08-28T04:12:07.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80372024-08-28T04:12:07.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80382024-08-28T04:12:07.131ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1414, tv_nsec: 216555144 } })
80392024-08-28T04:12:07.131ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
80402024-08-28T04:12:07.131ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80412024-08-28T04:12:07.131ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80422024-08-28T04:12:07.131ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
80432024-08-28T04:12:07.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80442024-08-28T04:12:07.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.697665ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
80452024-08-28T04:12:07.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80462024-08-28T04:12:07.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80472024-08-28T04:12:07.134ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80482024-08-28T04:12:07.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80492024-08-28T04:12:07.134ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.709134ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80502024-08-28T04:12:07.135ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80512024-08-28T04:12:07.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80522024-08-28T04:12:07.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80532024-08-28T04:12:07.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80542024-08-28T04:12:07.135ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80552024-08-28T04:12:07.135ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80562024-08-28T04:12:07.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80572024-08-28T04:12:07.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80582024-08-28T04:12:07.138ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80592024-08-28T04:12:07.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80602024-08-28T04:12:07.138ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80612024-08-28T04:12:07.139ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80622024-08-28T04:12:07.139ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80632024-08-28T04:12:07.140ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1414, tv_nsec: 225458106 } })
80642024-08-28T04:12:07.140ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
80652024-08-28T04:12:07.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80662024-08-28T04:12:07.141ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80672024-08-28T04:12:07.142ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80682024-08-28T04:12:07.142ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80692024-08-28T04:12:07.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80702024-08-28T04:12:07.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80712024-08-28T04:12:07.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
80722024-08-28T04:12:07.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80732024-08-28T04:12:07.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80742024-08-28T04:12:07.153ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80752024-08-28T04:12:07.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80762024-08-28T04:12:07.155ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
80772024-08-28T04:12:07.155ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.33652ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
80782024-08-28T04:12:07.156ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80792024-08-28T04:12:07.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80802024-08-28T04:12:07.157ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80812024-08-28T04:12:07.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80822024-08-28T04:12:07.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80832024-08-28T04:12:07.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
80842024-08-28T04:12:07.160ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80852024-08-28T04:12:07.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80862024-08-28T04:12:07.161ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.50872ms iteration = 14 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
80872024-08-28T04:12:07.162ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.15569ms iteration = 14 status = 0
80882024-08-28T04:12:07.164ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80892024-08-28T04:12:07.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80902024-08-28T04:12:07.166ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80912024-08-28T04:12:07.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80922024-08-28T04:12:07.180ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
80932024-08-28T04:12:07.180ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
80942024-08-28T04:12:07.180ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 120.706306ms iteration = 14 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
80952024-08-28T04:12:07.185ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80962024-08-28T04:12:07.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80972024-08-28T04:12:07.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80982024-08-28T04:12:07.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80992024-08-28T04:12:07.187ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 127.848045ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
81002024-08-28T04:12:07.211ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
81012024-08-28T04:12:07.211ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 152.51599ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
81022024-08-28T04:12:07.215ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
81032024-08-28T04:12:07.215ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81042024-08-28T04:12:07.216ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ab1d0a5f-d341-421d-b8db-5f78b0b5a2b0", "content-length": "26", "date": "Wed, 28 Aug 2024 04:12:07 GMT"} })
81052024-08-28T04:12:07.216ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81062024-08-28T04:12:07.218ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81072024-08-28T04:12:07.222ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
81082024-08-28T04:12:07.222ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81092024-08-28T04:12:07.222ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "80b840bf-8fb9-4542-bb26-31306d42099e", "content-length": "26", "date": "Wed, 28 Aug 2024 04:12:07 GMT"} })
81102024-08-28T04:12:07.222ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81112024-08-28T04:12:07.224ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81122024-08-28T04:12:07.266ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 206.936998ms iteration = 16 status = {"physical_disks_added":0}
81132024-08-28T04:12:07.276ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81142024-08-28T04:12:07.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81152024-08-28T04:12:07.291ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 zone_address = fd00:1122:3344:101::2
81162024-08-28T04:12:07.291ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81172024-08-28T04:12:07.291ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e444eb47-28f4-47a5-94bb-386957251b5a", "content-length": "26", "date": "Wed, 28 Aug 2024 04:12:07 GMT"} })
81182024-08-28T04:12:07.291ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81192024-08-28T04:12:07.292ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
81202024-08-28T04:12:07.320ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81212024-08-28T04:12:07.321ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "70451f1f-e1ec-463e-abb8-5c0887f1777f", "content-length": "583", "date": "Wed, 28 Aug 2024 04:12:06 GMT"} })
81222024-08-28T04:12:07.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81232024-08-28T04:12:07.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81242024-08-28T04:12:07.334ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81252024-08-28T04:12:07.334ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "90c135f2-5ab0-49ef-925b-8afb4cc7ecfc", "content-length": "1", "date": "Wed, 28 Aug 2024 04:12:06 GMT"} })
81262024-08-28T04:12:07.336ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81272024-08-28T04:12:07.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81282024-08-28T04:12:07.339ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/208e8b27-c88a-499b-a882-9c02530056ef/state
81292024-08-28T04:12:07.342ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81302024-08-28T04:12:07.342ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81312024-08-28T04:12:07.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81322024-08-28T04:12:07.343ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81332024-08-28T04:12:07.343ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81342024-08-28T04:12:07.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81352024-08-28T04:12:07.345ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 286.284639ms iteration = 14 status = null
81362024-08-28T04:12:07.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81372024-08-28T04:12:07.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81382024-08-28T04:12:07.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81392024-08-28T04:12:07.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81402024-08-28T04:12:07.350ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 291.521723ms iteration = 14 status = {}
81412024-08-28T04:12:07.352ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81422024-08-28T04:12:07.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81432024-08-28T04:12:07.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81442024-08-28T04:12:07.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81452024-08-28T04:12:07.357ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81462024-08-28T04:12:07.358ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "165e7f76-9d65-4676-b173-96be6716f625", "date": "Wed, 28 Aug 2024 04:12:06 GMT"} })
81472024-08-28T04:12:07.360ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 301.124255ms iteration = 15 status = {}
81482024-08-28T04:12:07.369ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81492024-08-28T04:12:07.371ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81502024-08-28T04:12:07.371ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81512024-08-28T04:12:07.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81522024-08-28T04:12:07.433ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81532024-08-28T04:12:07.433ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3471e8ae-3022-4216-8ef4-022902cb400f", "content-length": "810", "date": "Wed, 28 Aug 2024 04:12:06 GMT"} })
81542024-08-28T04:12:07.433ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 250, 46, 104])), vni: Vni(9741316) }} sled = sock
81552024-08-28T04:12:07.433ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
81562024-08-28T04:12:07.433ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
81572024-08-28T04:12:07.434ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 375.52541ms iteration = 14 status = {}
81582024-08-28T04:12:07.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81592024-08-28T04:12:07.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81602024-08-28T04:12:07.448ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 21872882-9c7e-4a12-8d80-3d3b1686a012, rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(726f0c10-a692-46cf-962b-4ac9a2a107fc) } rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
81612024-08-28T04:12:07.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81622024-08-28T04:12:07.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81632024-08-28T04:12:07.458ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
81642024-08-28T04:12:07.458ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5cb25b5c-603b-41aa-90b9-4a322b0ee616", "content-length": "121", "date": "Wed, 28 Aug 2024 04:12:06 GMT"} })
81652024-08-28T04:12:07.458ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
81662024-08-28T04:12:07.458ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 726f0c10-a692-46cf-962b-4ac9a2a107fc
81672024-08-28T04:12:07.459ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81682024-08-28T04:12:07.459ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81692024-08-28T04:12:07.459ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
81702024-08-28T04:12:07.459ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
81712024-08-28T04:12:07.459ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
81722024-08-28T04:12:07.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81732024-08-28T04:12:07.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81742024-08-28T04:12:07.461ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81752024-08-28T04:12:07.461ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3b10588d-b30b-42fe-a4d3-d0fd398ee294", "content-length": "2", "date": "Wed, 28 Aug 2024 04:12:06 GMT"} })
81762024-08-28T04:12:07.461ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81772024-08-28T04:12:07.462ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4a080151-ddb4-4b98-98a6-61da386635d3", "content-length": "50", "date": "Wed, 28 Aug 2024 04:12:06 GMT"} })
81782024-08-28T04:12:07.462ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
81792024-08-28T04:12:07.462ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81802024-08-28T04:12:07.569ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9c13df6c-0889-4692-9142-fbf2aaa70df4", "date": "Wed, 28 Aug 2024 04:12:06 GMT"} })
81812024-08-28T04:12:07.569ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch = Switch0
81822024-08-28T04:12:07.569ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81832024-08-28T04:12:07.569ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "884f6536-cfb6-44a3-b406-a7e7faf022ec", "content-length": "667", "date": "Wed, 28 Aug 2024 04:12:06 GMT"} })
81842024-08-28T04:12:07.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81852024-08-28T04:12:07.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81862024-08-28T04:12:07.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81872024-08-28T04:12:07.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81882024-08-28T04:12:07.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81892024-08-28T04:12:07.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81902024-08-28T04:12:07.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81912024-08-28T04:12:07.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81922024-08-28T04:12:07.589ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 530.076321ms iteration = 14 status = {}
81932024-08-28T04:12:09.884ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vmms/208e8b27-c88a-499b-a882-9c02530056ef/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4fb51d44-e5b9-4ca9-b906-610a682333d4", "content-length": "128", "date": "Wed, 28 Aug 2024 04:12:09 GMT"} })
81942024-08-28T04:12:09.884ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 533126e7-adf4-4e3a-b0c9-69b6af4c2b1b state = Starting
81952024-08-28T04:12:09.887ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:1853 instance_id = 533126e7-adf4-4e3a-b0c9-69b6af4c2b1b migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 208e8b27-c88a-499b-a882-9c02530056ef vmm_state = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-08-28T04:12:00.399638Z }
81962024-08-28T04:12:09.887ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 533126e7-adf4-4e3a-b0c9-69b6af4c2b1b roles = RoleSet { roles: {} }
81972024-08-28T04:12:09.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 533126e7-adf4-4e3a-b0c9-69b6af4c2b1b resource = Database result = Ok(())
81982024-08-28T04:12:09.921ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:33979
81992024-08-28T04:12:09.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33979 req_id = 142e4688-7886-428b-8903-4402f0650aec roles = RoleSet { roles: {} } uri = /metrics/producers
82002024-08-28T04:12:09.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33979 req_id = 142e4688-7886-428b-8903-4402f0650aec resource = Database result = Ok(()) uri = /metrics/producers
82012024-08-28T04:12:09.951ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
82022024-08-28T04:12:09.951ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 2.892075959s iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
82032024-08-28T04:12:09.955ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
82042024-08-28T04:12:09.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33979 req_id = 142e4688-7886-428b-8903-4402f0650aec roles = RoleSet { roles: {} } uri = /metrics/producers
82052024-08-28T04:12:09.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33979 req_id = 142e4688-7886-428b-8903-4402f0650aec resource = Database result = Ok(()) uri = /metrics/producers
82062024-08-28T04:12:09.993ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
82072024-08-28T04:12:09.994ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3096d0a1-4547-4c3c-a369-e24c87391a36", "date": "Wed, 28 Aug 2024 04:12:09 GMT"} })
82082024-08-28T04:12:09.994ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 533126e7-adf4-4e3a-b0c9-69b6af4c2b1b
82092024-08-28T04:12:09.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 75219 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33979 req_id = 142e4688-7886-428b-8903-4402f0650aec response_code = 201 uri = /metrics/producers
82102024-08-28T04:12:11.274ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3437 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = d8bac96e-ec42-47e7-af53-470def2846b0 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
82112024-08-28T04:12:17.059ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
82122024-08-28T04:12:17.059ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
82132024-08-28T04:12:17.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82142024-08-28T04:12:17.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82152024-08-28T04:12:17.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82162024-08-28T04:12:17.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82172024-08-28T04:12:17.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82182024-08-28T04:12:17.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82192024-08-28T04:12:17.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82202024-08-28T04:12:17.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82212024-08-28T04:12:17.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82222024-08-28T04:12:17.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82232024-08-28T04:12:17.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82242024-08-28T04:12:17.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
82252024-08-28T04:12:17.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82262024-08-28T04:12:17.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82272024-08-28T04:12:17.075ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
82282024-08-28T04:12:17.075ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.710151ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
82292024-08-28T04:12:17.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82302024-08-28T04:12:17.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82312024-08-28T04:12:17.116ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.420956ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82322024-08-28T04:12:21.272ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1314 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 27538d35-c72a-4e55-924d-007a5e5177c0 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
82332024-08-28T04:12:26.593ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:43261
82342024-08-28T04:12:26.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43261 req_id = 279342e6-361e-4562-88f3-4996afa46bd3 roles = RoleSet { roles: {} } uri = /metrics/producers
82352024-08-28T04:12:26.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43261 req_id = 279342e6-361e-4562-88f3-4996afa46bd3 resource = Database result = Ok(()) uri = /metrics/producers
82362024-08-28T04:12:26.627ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
82372024-08-28T04:12:26.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43261 req_id = 279342e6-361e-4562-88f3-4996afa46bd3 roles = RoleSet { roles: {} } uri = /metrics/producers
82382024-08-28T04:12:26.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43261 req_id = 279342e6-361e-4562-88f3-4996afa46bd3 resource = Database result = Ok(()) uri = /metrics/producers
82392024-08-28T04:12:26.700ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
82402024-08-28T04:12:26.700ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1e79f0d8-4ad0-48d0-8d5c-022c8b9efad1", "date": "Wed, 28 Aug 2024 04:12:26 GMT"} })
82412024-08-28T04:12:26.700ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 5c7c3da2-1911-473e-8087-8b75e35a21c4
82422024-08-28T04:12:26.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 108414 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43261 req_id = 279342e6-361e-4562-88f3-4996afa46bd3 response_code = 201 uri = /metrics/producers
82432024-08-28T04:12:27.058ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
82442024-08-28T04:12:27.058ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
82452024-08-28T04:12:27.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82462024-08-28T04:12:27.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82472024-08-28T04:12:27.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82482024-08-28T04:12:27.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82492024-08-28T04:12:27.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82502024-08-28T04:12:27.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82512024-08-28T04:12:27.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82522024-08-28T04:12:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82532024-08-28T04:12:27.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82542024-08-28T04:12:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82552024-08-28T04:12:27.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82562024-08-28T04:12:27.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82572024-08-28T04:12:27.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82582024-08-28T04:12:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
82592024-08-28T04:12:27.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82602024-08-28T04:12:27.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82612024-08-28T04:12:27.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
82622024-08-28T04:12:27.079ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.872043ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
82632024-08-28T04:12:27.095ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.800361ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82642024-08-28T04:12:31.272ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1406 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 2015cf47-82a2-4fb4-8184-1466e1dad024 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
82652024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
82662024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
82672024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
82682024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
82692024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82702024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82712024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
82722024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
82732024-08-28T04:12:37.058ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
82742024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82752024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82762024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
82772024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
82782024-08-28T04:12:37.058ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 04:02:37.058650929 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
82792024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82802024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
82812024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
82822024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
82832024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82842024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
82852024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
82862024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82872024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
82882024-08-28T04:12:37.058ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
82892024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
82902024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
82912024-08-28T04:12:37.058ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
82922024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
82932024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
82942024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
82952024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
82962024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
82972024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
82982024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82992024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
83002024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
83012024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
83022024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
83032024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83042024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83052024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83062024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
83072024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
83082024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83092024-08-28T04:12:37.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83102024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
83112024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
83122024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
83132024-08-28T04:12:37.059ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764
83142024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.821\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764"}
83152024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
83162024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
83172024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83182024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
83192024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
83202024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83212024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83222024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
83232024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83242024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83252024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83262024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83272024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
83282024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
83292024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
83302024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83312024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83322024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
83332024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83342024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
83352024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
83362024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83372024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83382024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83392024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83402024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83412024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83422024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83432024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83442024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83452024-08-28T04:12:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83462024-08-28T04:12:37.059ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4eb364e4-14a2-46c4-b173-eb2890920e8f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 144914370 } })
83472024-08-28T04:12:37.059ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("037b07ce-9e39-4982-8c20-c4c38f448b97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4e2ba65e-422a-4b1e-b0e3-85f8149a979a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 145006353 } })
83482024-08-28T04:12:37.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83492024-08-28T04:12:37.062ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
83502024-08-28T04:12:37.062ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.655597ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
83512024-08-28T04:12:37.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83522024-08-28T04:12:37.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83532024-08-28T04:12:37.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83542024-08-28T04:12:37.065ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
83552024-08-28T04:12:37.065ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.719677ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
83562024-08-28T04:12:37.067ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.607863ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83572024-08-28T04:12:37.078ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 04:02:37.058650929 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
83582024-08-28T04:12:37.078ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.931035ms iteration = 8 status = {"expiration":"2024-08-28T04:02:37.058650929Z","pruned":[]}
83592024-08-28T04:12:37.080ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83602024-08-28T04:12:37.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83612024-08-28T04:12:37.085ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 170247794 } })
83622024-08-28T04:12:37.086ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 171727887 } })
83632024-08-28T04:12:37.086ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
83642024-08-28T04:12:37.086ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
83652024-08-28T04:12:37.089ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 30.97415ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
83662024-08-28T04:12:37.092ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
83672024-08-28T04:12:37.092ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
83682024-08-28T04:12:37.092ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83692024-08-28T04:12:37.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83702024-08-28T04:12:37.092ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83712024-08-28T04:12:37.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83722024-08-28T04:12:37.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83732024-08-28T04:12:37.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83742024-08-28T04:12:37.095ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83752024-08-28T04:12:37.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
83762024-08-28T04:12:37.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83772024-08-28T04:12:37.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
83782024-08-28T04:12:37.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83792024-08-28T04:12:37.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83802024-08-28T04:12:37.110ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.144411ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
83812024-08-28T04:12:37.111ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83822024-08-28T04:12:37.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83832024-08-28T04:12:37.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 58.595301ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
83842024-08-28T04:12:37.124ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83852024-08-28T04:12:37.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83862024-08-28T04:12:37.129ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
83872024-08-28T04:12:37.129ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
83882024-08-28T04:12:37.129ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 71.180871ms iteration = 8 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
83892024-08-28T04:12:37.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83902024-08-28T04:12:37.131ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83912024-08-28T04:12:37.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83922024-08-28T04:12:37.133ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83932024-08-28T04:12:37.134ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83942024-08-28T04:12:37.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83952024-08-28T04:12:37.134ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
83962024-08-28T04:12:37.134ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.323082ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
83972024-08-28T04:12:37.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
83982024-08-28T04:12:37.134ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83992024-08-28T04:12:37.134ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84002024-08-28T04:12:37.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84012024-08-28T04:12:37.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84022024-08-28T04:12:37.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
84032024-08-28T04:12:37.136ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84042024-08-28T04:12:37.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
84052024-08-28T04:12:37.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
84062024-08-28T04:12:37.137ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84072024-08-28T04:12:37.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84082024-08-28T04:12:37.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
84092024-08-28T04:12:37.138ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84102024-08-28T04:12:37.138ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
84112024-08-28T04:12:37.138ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84122024-08-28T04:12:37.138ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 79.399682ms iteration = 15 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
84132024-08-28T04:12:37.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84142024-08-28T04:12:37.141ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84152024-08-28T04:12:37.142ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84162024-08-28T04:12:37.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84172024-08-28T04:12:37.143ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 228746392 } })
84182024-08-28T04:12:37.143ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
84192024-08-28T04:12:37.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84202024-08-28T04:12:37.144ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84212024-08-28T04:12:37.144ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84222024-08-28T04:12:37.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84232024-08-28T04:12:37.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84242024-08-28T04:12:37.145ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84252024-08-28T04:12:37.147ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84262024-08-28T04:12:37.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84272024-08-28T04:12:37.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
84282024-08-28T04:12:37.147ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84292024-08-28T04:12:37.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84302024-08-28T04:12:37.149ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84312024-08-28T04:12:37.151ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84322024-08-28T04:12:37.151ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84332024-08-28T04:12:37.151ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.699343ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
84342024-08-28T04:12:37.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84352024-08-28T04:12:37.152ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
84362024-08-28T04:12:37.152ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
84372024-08-28T04:12:37.152ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
84382024-08-28T04:12:37.152ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84392024-08-28T04:12:37.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84402024-08-28T04:12:37.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84412024-08-28T04:12:37.155ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84422024-08-28T04:12:37.157ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84432024-08-28T04:12:37.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84442024-08-28T04:12:37.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84452024-08-28T04:12:37.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84462024-08-28T04:12:37.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84472024-08-28T04:12:37.161ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
84482024-08-28T04:12:37.161ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 0 version = 2
84492024-08-28T04:12:37.161ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84502024-08-28T04:12:37.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84512024-08-28T04:12:37.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84522024-08-28T04:12:37.168ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84532024-08-28T04:12:37.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84542024-08-28T04:12:37.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84552024-08-28T04:12:37.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84562024-08-28T04:12:37.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84572024-08-28T04:12:37.174ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 1 version = 2
84582024-08-28T04:12:37.174ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
84592024-08-28T04:12:37.174ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 04:05:50.133665 UTC dns_group = external generation = 2
84602024-08-28T04:12:37.174ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 115.474472ms iteration = 9 status = {"generation":2}
84612024-08-28T04:12:37.178ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
84622024-08-28T04:12:37.179ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84632024-08-28T04:12:37.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84642024-08-28T04:12:37.180ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
84652024-08-28T04:12:37.180ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
84662024-08-28T04:12:37.180ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 122.129317ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
84672024-08-28T04:12:37.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84682024-08-28T04:12:37.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84692024-08-28T04:12:37.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84702024-08-28T04:12:37.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84712024-08-28T04:12:37.187ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84722024-08-28T04:12:37.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84732024-08-28T04:12:37.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84742024-08-28T04:12:37.191ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84752024-08-28T04:12:37.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
84762024-08-28T04:12:37.192ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84772024-08-28T04:12:37.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84782024-08-28T04:12:37.193ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 134.347256ms iteration = 15 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
84792024-08-28T04:12:37.193ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
84802024-08-28T04:12:37.193ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
84812024-08-28T04:12:37.193ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
84822024-08-28T04:12:37.193ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84832024-08-28T04:12:37.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84842024-08-28T04:12:37.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84852024-08-28T04:12:37.194ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84862024-08-28T04:12:37.194ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 135.181861ms iteration = 15 status = 0
84872024-08-28T04:12:37.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84882024-08-28T04:12:37.196ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
84892024-08-28T04:12:37.196ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 138.004864ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84902024-08-28T04:12:37.203ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84912024-08-28T04:12:37.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
84922024-08-28T04:12:37.205ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84932024-08-28T04:12:37.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84942024-08-28T04:12:37.206ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
84952024-08-28T04:12:37.206ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 147.753051ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
84962024-08-28T04:12:37.220ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84972024-08-28T04:12:37.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84982024-08-28T04:12:37.358ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
84992024-08-28T04:12:37.361ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
85002024-08-28T04:12:37.362ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6b2db011-8c70-410d-bb81-4399c39ed5e8", "date": "Wed, 28 Aug 2024 04:12:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
85012024-08-28T04:12:37.362ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
85022024-08-28T04:12:37.364ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2689d726-b24e-4787-a184-e4db9fb97cba", "date": "Wed, 28 Aug 2024 04:12:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
85032024-08-28T04:12:37.364ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
85042024-08-28T04:12:37.365ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
85052024-08-28T04:12:37.365ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 307.143721ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
85062024-08-28T04:12:37.366ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85072024-08-28T04:12:37.366ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b85656a7-77a8-4544-8f2d-35754c71e06f", "content-length": "372", "date": "Wed, 28 Aug 2024 04:12:37 GMT"} })
85082024-08-28T04:12:37.366ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85092024-08-28T04:12:37.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85102024-08-28T04:12:37.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85112024-08-28T04:12:37.370ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85122024-08-28T04:12:37.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85132024-08-28T04:12:37.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85142024-08-28T04:12:37.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85152024-08-28T04:12:37.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85162024-08-28T04:12:37.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85172024-08-28T04:12:37.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85182024-08-28T04:12:37.376ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85192024-08-28T04:12:37.377ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c0c5ec3a-9e9b-45bd-8b9a-d7a6af9a5945", "date": "Wed, 28 Aug 2024 04:12:37 GMT"} })
85202024-08-28T04:12:37.378ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 319.590528ms iteration = 16 status = {}
85212024-08-28T04:12:37.397ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
85222024-08-28T04:12:37.397ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
85232024-08-28T04:12:37.397ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85242024-08-28T04:12:37.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85252024-08-28T04:12:37.402ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85262024-08-28T04:12:37.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85272024-08-28T04:12:37.404ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85282024-08-28T04:12:37.406ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85292024-08-28T04:12:37.406ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85302024-08-28T04:12:37.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85312024-08-28T04:12:37.423ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
85322024-08-28T04:12:37.423ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85332024-08-28T04:12:37.423ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "42152ada-a9e5-49c1-a47f-5a459ec82810", "content-length": "26", "date": "Wed, 28 Aug 2024 04:12:36 GMT"} })
85342024-08-28T04:12:37.423ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85352024-08-28T04:12:37.424ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85362024-08-28T04:12:37.426ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85372024-08-28T04:12:37.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85382024-08-28T04:12:37.427ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85392024-08-28T04:12:37.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85402024-08-28T04:12:37.430ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
85412024-08-28T04:12:37.430ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
85422024-08-28T04:12:37.430ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 04:05:49.286960 UTC dns_group = internal generation = 1
85432024-08-28T04:12:37.430ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 371.41671ms iteration = 9 status = {"generation":1}
85442024-08-28T04:12:37.435ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
85452024-08-28T04:12:37.435ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85462024-08-28T04:12:37.435ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "baa5a7e7-7b73-4231-a140-fc7cdd1b5cd1", "content-length": "26", "date": "Wed, 28 Aug 2024 04:12:36 GMT"} })
85472024-08-28T04:12:37.435ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85482024-08-28T04:12:37.437ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85492024-08-28T04:12:37.457ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85502024-08-28T04:12:37.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85512024-08-28T04:12:37.459ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85522024-08-28T04:12:37.461ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85532024-08-28T04:12:37.461ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85542024-08-28T04:12:37.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85552024-08-28T04:12:37.462ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T04:05:35.065116Z, time_modified: 2024-08-28T04:05:35.065116Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
85562024-08-28T04:12:37.462ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 404.046458ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]}},"default_endpoint":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
85572024-08-28T04:12:37.463ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85582024-08-28T04:12:37.465ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85592024-08-28T04:12:37.465ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85602024-08-28T04:12:37.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85612024-08-28T04:12:37.467ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 408.808948ms iteration = 17 status = {"physical_disks_added":0}
85622024-08-28T04:12:37.486ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
85632024-08-28T04:12:37.487ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f15d82a0-ee3a-4e04-800a-ed05c25a0d53", "date": "Wed, 28 Aug 2024 04:12:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
85642024-08-28T04:12:37.487ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
85652024-08-28T04:12:37.490ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bbe96ccd-a517-405f-8cb7-e9f1aa9348b8", "date": "Wed, 28 Aug 2024 04:12:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
85662024-08-28T04:12:37.490ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
85672024-08-28T04:12:37.491ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "20d75879-93ac-41c7-8b35-b57a249faf3d", "date": "Wed, 28 Aug 2024 04:12:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
85682024-08-28T04:12:37.491ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
85692024-08-28T04:12:37.493ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
85702024-08-28T04:12:37.493ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 434.664588ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
85712024-08-28T04:12:37.493ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 zone_address = fd00:1122:3344:101::2
85722024-08-28T04:12:37.493ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85732024-08-28T04:12:37.493ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3b8864b0-7ecc-4515-9e26-c5eefd52b9cd", "content-length": "26", "date": "Wed, 28 Aug 2024 04:12:36 GMT"} })
85742024-08-28T04:12:37.493ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85752024-08-28T04:12:37.495ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
85762024-08-28T04:12:37.569ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 510.892806ms iteration = 15 status = {}
85772024-08-28T04:12:37.603ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85782024-08-28T04:12:37.608ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
85792024-08-28T04:12:37.608ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "78cb98de-3dbc-49ce-b7a0-7f39494e6201", "content-length": "2", "date": "Wed, 28 Aug 2024 04:12:37 GMT"} })
85802024-08-28T04:12:37.610ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85812024-08-28T04:12:37.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85822024-08-28T04:12:37.613ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 554.526628ms iteration = 15 status = null
85832024-08-28T04:12:37.699ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ac1bc695-2466-46c0-adba-5b6f95bfd25f", "content-length": "691", "date": "Wed, 28 Aug 2024 04:12:37 GMT"} })
85842024-08-28T04:12:37.699ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
85852024-08-28T04:12:37.699ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
85862024-08-28T04:12:37.699ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
85872024-08-28T04:12:37.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85882024-08-28T04:12:37.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85892024-08-28T04:12:37.701ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 642.381158ms iteration = 15 status = {}
85902024-08-28T04:12:37.704ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 21872882-9c7e-4a12-8d80-3d3b1686a012, rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(726f0c10-a692-46cf-962b-4ac9a2a107fc) } rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
85912024-08-28T04:12:37.704ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85922024-08-28T04:12:37.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85932024-08-28T04:12:37.716ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
85942024-08-28T04:12:37.717ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "68e02dae-90cc-4165-9901-29724c8beba0", "content-length": "121", "date": "Wed, 28 Aug 2024 04:12:37 GMT"} })
85952024-08-28T04:12:37.717ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
85962024-08-28T04:12:37.717ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 726f0c10-a692-46cf-962b-4ac9a2a107fc
85972024-08-28T04:12:37.717ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85982024-08-28T04:12:37.717ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85992024-08-28T04:12:37.717ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
86002024-08-28T04:12:37.717ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
86012024-08-28T04:12:37.717ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
86022024-08-28T04:12:37.717ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86032024-08-28T04:12:37.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86042024-08-28T04:12:37.721ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
86052024-08-28T04:12:37.721ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d6b4c798-74f8-4aec-b326-b92d978d4074", "content-length": "2", "date": "Wed, 28 Aug 2024 04:12:37 GMT"} })
86062024-08-28T04:12:37.721ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
86072024-08-28T04:12:37.721ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "99ff3cf0-f22a-4a6f-b435-52a3a77678df", "content-length": "50", "date": "Wed, 28 Aug 2024 04:12:37 GMT"} })
86082024-08-28T04:12:37.721ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
86092024-08-28T04:12:37.721ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
86102024-08-28T04:12:37.848ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "48ae8367-aed8-40e1-95d4-9a7fd9ceb32a", "date": "Wed, 28 Aug 2024 04:12:37 GMT"} })
86112024-08-28T04:12:37.848ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch = Switch0
86122024-08-28T04:12:37.848ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
86132024-08-28T04:12:37.848ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bdc44ba1-ed26-4994-bfee-be487e0d5e8c", "content-length": "667", "date": "Wed, 28 Aug 2024 04:12:37 GMT"} })
86142024-08-28T04:12:37.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86152024-08-28T04:12:37.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86162024-08-28T04:12:37.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86172024-08-28T04:12:37.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86182024-08-28T04:12:37.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86192024-08-28T04:12:37.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86202024-08-28T04:12:37.860ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86212024-08-28T04:12:37.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86222024-08-28T04:12:37.868ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 809.115926ms iteration = 15 status = {}
86232024-08-28T04:12:41.272ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1274 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = b7242fc7-861a-4c81-ad23-04c00d0204cb response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
86242024-08-28T04:12:47.013ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:46746
86252024-08-28T04:12:47.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46746 req_id = 21d5aeab-151a-4fa5-a9c0-3f6d81c8a20f roles = RoleSet { roles: {} } uri = /metrics/producers
86262024-08-28T04:12:47.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46746 req_id = 21d5aeab-151a-4fa5-a9c0-3f6d81c8a20f resource = Database result = Ok(()) uri = /metrics/producers
86272024-08-28T04:12:47.047ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
86282024-08-28T04:12:47.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46746 req_id = 21d5aeab-151a-4fa5-a9c0-3f6d81c8a20f roles = RoleSet { roles: {} } uri = /metrics/producers
86292024-08-28T04:12:47.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46746 req_id = 21d5aeab-151a-4fa5-a9c0-3f6d81c8a20f resource = Database result = Ok(()) uri = /metrics/producers
86302024-08-28T04:12:47.058ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
86312024-08-28T04:12:47.058ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
86322024-08-28T04:12:47.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86332024-08-28T04:12:47.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86342024-08-28T04:12:47.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86352024-08-28T04:12:47.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86362024-08-28T04:12:47.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86372024-08-28T04:12:47.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86382024-08-28T04:12:47.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86392024-08-28T04:12:47.092ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
86402024-08-28T04:12:47.093ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e7a29862-7531-4b26-b3f8-c92a8b0c7275", "date": "Wed, 28 Aug 2024 04:12:47 GMT"} })
86412024-08-28T04:12:47.093ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = f62e5a13-51f3-4379-acf3-2f8e8601ac1f
86422024-08-28T04:12:47.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86432024-08-28T04:12:47.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86442024-08-28T04:12:47.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86452024-08-28T04:12:47.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 81070 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46746 req_id = 21d5aeab-151a-4fa5-a9c0-3f6d81c8a20f response_code = 201 uri = /metrics/producers
86462024-08-28T04:12:47.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86472024-08-28T04:12:47.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86482024-08-28T04:12:47.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86492024-08-28T04:12:47.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
86502024-08-28T04:12:47.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86512024-08-28T04:12:47.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86522024-08-28T04:12:47.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
86532024-08-28T04:12:47.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.505904ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
86542024-08-28T04:12:47.112ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.705177ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86552024-08-28T04:12:51.272ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1365 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 232dce34-3fb9-438a-9e91-e859a5b0a001 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
86562024-08-28T04:12:57.058ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
86572024-08-28T04:12:57.058ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
86582024-08-28T04:12:57.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86592024-08-28T04:12:57.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86602024-08-28T04:12:57.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86612024-08-28T04:12:57.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86622024-08-28T04:12:57.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86632024-08-28T04:12:57.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86642024-08-28T04:12:57.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86652024-08-28T04:12:57.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86662024-08-28T04:12:57.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86672024-08-28T04:12:57.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86682024-08-28T04:12:57.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86692024-08-28T04:12:57.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86702024-08-28T04:12:57.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86712024-08-28T04:12:57.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
86722024-08-28T04:12:57.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86732024-08-28T04:12:57.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86742024-08-28T04:12:57.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
86752024-08-28T04:12:57.079ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.033528ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
86762024-08-28T04:12:57.092ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.609878ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86772024-08-28T04:13:01.271ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1344 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = e34c5868-2e7b-42d1-ada8-b5154061baa9 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
86782024-08-28T04:13:07.057ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
86792024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
86802024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
86812024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86822024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86832024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86842024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
86852024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86862024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
86872024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
86882024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86892024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
86902024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86912024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86922024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
86932024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
86942024-08-28T04:13:07.058ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
86952024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86962024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86972024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
86982024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86992024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
87002024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87012024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
87022024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87032024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
87042024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
87052024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87062024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
87072024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87082024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
87092024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87102024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87112024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87122024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87132024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87142024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87152024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87162024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87172024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87182024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87192024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
87202024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87212024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87222024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
87232024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87242024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87252024-08-28T04:13:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87262024-08-28T04:13:07.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87272024-08-28T04:13:07.061ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87282024-08-28T04:13:07.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87292024-08-28T04:13:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87302024-08-28T04:13:07.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87312024-08-28T04:13:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87322024-08-28T04:13:07.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87332024-08-28T04:13:07.065ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.279584ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
87342024-08-28T04:13:07.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
87352024-08-28T04:13:07.065ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87362024-08-28T04:13:07.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87372024-08-28T04:13:07.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
87382024-08-28T04:13:07.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87392024-08-28T04:13:07.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87402024-08-28T04:13:07.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87412024-08-28T04:13:07.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87422024-08-28T04:13:07.067ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87432024-08-28T04:13:07.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87442024-08-28T04:13:07.068ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87452024-08-28T04:13:07.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87462024-08-28T04:13:07.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87472024-08-28T04:13:07.070ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87482024-08-28T04:13:07.072ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1474, tv_nsec: 158390265 } })
87492024-08-28T04:13:07.073ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1474, tv_nsec: 158558360 } })
87502024-08-28T04:13:07.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
87512024-08-28T04:13:07.074ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87522024-08-28T04:13:07.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87532024-08-28T04:13:07.074ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
87542024-08-28T04:13:07.075ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
87552024-08-28T04:13:07.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87562024-08-28T04:13:07.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87572024-08-28T04:13:07.078ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87582024-08-28T04:13:07.079ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1474, tv_nsec: 164836865 } })
87592024-08-28T04:13:07.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87602024-08-28T04:13:07.079ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
87612024-08-28T04:13:07.080ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87622024-08-28T04:13:07.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87632024-08-28T04:13:07.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 44.369323ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
87642024-08-28T04:13:07.106ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
87652024-08-28T04:13:07.106ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
87662024-08-28T04:13:07.106ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87672024-08-28T04:13:07.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87682024-08-28T04:13:07.110ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
87692024-08-28T04:13:07.110ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
87702024-08-28T04:13:07.110ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 52.307247ms iteration = 16 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
87712024-08-28T04:13:07.115ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87722024-08-28T04:13:07.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87732024-08-28T04:13:07.116ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87742024-08-28T04:13:07.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87752024-08-28T04:13:07.119ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87762024-08-28T04:13:07.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87772024-08-28T04:13:07.122ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87782024-08-28T04:13:07.123ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87792024-08-28T04:13:07.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87802024-08-28T04:13:07.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87812024-08-28T04:13:07.126ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87822024-08-28T04:13:07.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87832024-08-28T04:13:07.129ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87842024-08-28T04:13:07.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87852024-08-28T04:13:07.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87862024-08-28T04:13:07.129ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87872024-08-28T04:13:07.131ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87882024-08-28T04:13:07.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87892024-08-28T04:13:07.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87902024-08-28T04:13:07.132ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87912024-08-28T04:13:07.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87922024-08-28T04:13:07.133ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87932024-08-28T04:13:07.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87942024-08-28T04:13:07.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
87952024-08-28T04:13:07.134ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87962024-08-28T04:13:07.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87972024-08-28T04:13:07.145ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
87982024-08-28T04:13:07.145ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 87.583543ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
87992024-08-28T04:13:07.152ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.089593ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88002024-08-28T04:13:07.160ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
88012024-08-28T04:13:07.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 102.348146ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
88022024-08-28T04:13:07.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 102.354996ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
88032024-08-28T04:13:07.163ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 104.920392ms iteration = 16 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
88042024-08-28T04:13:07.167ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
88052024-08-28T04:13:07.167ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88062024-08-28T04:13:07.167ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c8111a08-2c4f-4cd8-aaf5-4e3898288ebd", "content-length": "26", "date": "Wed, 28 Aug 2024 04:13:06 GMT"} })
88072024-08-28T04:13:07.167ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88082024-08-28T04:13:07.169ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88092024-08-28T04:13:07.169ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88102024-08-28T04:13:07.171ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 zone_address = fd00:1122:3344:101::2
88112024-08-28T04:13:07.171ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88122024-08-28T04:13:07.171ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
88132024-08-28T04:13:07.171ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 113.523364ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
88142024-08-28T04:13:07.171ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "13ad814f-0ece-4d92-aeab-2ad391f69c56", "content-length": "26", "date": "Wed, 28 Aug 2024 04:13:06 GMT"} })
88152024-08-28T04:13:07.171ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88162024-08-28T04:13:07.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
88172024-08-28T04:13:07.172ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88182024-08-28T04:13:07.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88192024-08-28T04:13:07.173ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
88202024-08-28T04:13:07.174ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 116.652376ms iteration = 16 status = 0
88212024-08-28T04:13:07.177ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
88222024-08-28T04:13:07.177ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88232024-08-28T04:13:07.177ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "847211e4-1449-4a84-baf8-49acea2999f6", "content-length": "26", "date": "Wed, 28 Aug 2024 04:13:06 GMT"} })
88242024-08-28T04:13:07.177ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88252024-08-28T04:13:07.178ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88262024-08-28T04:13:07.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88272024-08-28T04:13:07.179ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88282024-08-28T04:13:07.238ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 180.894754ms iteration = 18 status = {"physical_disks_added":0}
88292024-08-28T04:13:07.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88302024-08-28T04:13:07.264ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
88312024-08-28T04:13:07.264ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e50a406f-6379-4fcc-b30e-f1d6947351fe", "content-length": "2", "date": "Wed, 28 Aug 2024 04:13:07 GMT"} })
88322024-08-28T04:13:07.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88332024-08-28T04:13:07.265ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 207.69672ms iteration = 16 status = {}
88342024-08-28T04:13:07.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88352024-08-28T04:13:07.266ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88362024-08-28T04:13:07.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88372024-08-28T04:13:07.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
88382024-08-28T04:13:07.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88392024-08-28T04:13:07.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88402024-08-28T04:13:07.268ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 210.667178ms iteration = 16 status = null
88412024-08-28T04:13:07.290ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88422024-08-28T04:13:07.291ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6825dab9-63d5-4843-a72c-0d47a9399019", "content-length": "372", "date": "Wed, 28 Aug 2024 04:13:06 GMT"} })
88432024-08-28T04:13:07.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88442024-08-28T04:13:07.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88452024-08-28T04:13:07.292ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88462024-08-28T04:13:07.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88472024-08-28T04:13:07.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88482024-08-28T04:13:07.294ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
88492024-08-28T04:13:07.294ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88502024-08-28T04:13:07.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88512024-08-28T04:13:07.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88522024-08-28T04:13:07.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88532024-08-28T04:13:07.299ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88542024-08-28T04:13:07.300ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ad75d7ad-ef69-441b-8b5c-a6fc768f8cc1", "date": "Wed, 28 Aug 2024 04:13:06 GMT"} })
88552024-08-28T04:13:07.301ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 243.314357ms iteration = 17 status = {}
88562024-08-28T04:13:07.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88572024-08-28T04:13:07.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88582024-08-28T04:13:07.341ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 21872882-9c7e-4a12-8d80-3d3b1686a012, rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(726f0c10-a692-46cf-962b-4ac9a2a107fc) } rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
88592024-08-28T04:13:07.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88602024-08-28T04:13:07.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88612024-08-28T04:13:07.371ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
88622024-08-28T04:13:07.371ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aabdb2db-c094-43e8-863b-cfb3d52ff65c", "content-length": "691", "date": "Wed, 28 Aug 2024 04:13:06 GMT"} })
88632024-08-28T04:13:07.371ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
88642024-08-28T04:13:07.371ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
88652024-08-28T04:13:07.371ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
88662024-08-28T04:13:07.372ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 314.169769ms iteration = 16 status = {}
88672024-08-28T04:13:07.379ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
88682024-08-28T04:13:07.380ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f17e8955-78ef-47fa-8bc4-96e7373e0d3d", "content-length": "121", "date": "Wed, 28 Aug 2024 04:13:07 GMT"} })
88692024-08-28T04:13:07.380ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
88702024-08-28T04:13:07.380ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 726f0c10-a692-46cf-962b-4ac9a2a107fc
88712024-08-28T04:13:07.380ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
88722024-08-28T04:13:07.380ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
88732024-08-28T04:13:07.380ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
88742024-08-28T04:13:07.380ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
88752024-08-28T04:13:07.380ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
88762024-08-28T04:13:07.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88772024-08-28T04:13:07.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88782024-08-28T04:13:07.382ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
88792024-08-28T04:13:07.383ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a51e78fd-2a59-467f-a904-24722e04f22a", "content-length": "2", "date": "Wed, 28 Aug 2024 04:13:07 GMT"} })
88802024-08-28T04:13:07.383ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
88812024-08-28T04:13:07.383ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f0e0ab04-bac7-4023-8b8c-7bc5bba6b589", "content-length": "50", "date": "Wed, 28 Aug 2024 04:13:07 GMT"} })
88822024-08-28T04:13:07.383ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
88832024-08-28T04:13:07.383ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
88842024-08-28T04:13:07.478ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "95728d77-87cf-4ceb-9f2d-ae321c12bea5", "date": "Wed, 28 Aug 2024 04:13:06 GMT"} })
88852024-08-28T04:13:07.478ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch = Switch0
88862024-08-28T04:13:07.478ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
88872024-08-28T04:13:07.478ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c4195d69-83f5-437e-a600-7ac975c6d7b5", "content-length": "667", "date": "Wed, 28 Aug 2024 04:13:06 GMT"} })
88882024-08-28T04:13:07.478ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88892024-08-28T04:13:07.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88902024-08-28T04:13:07.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88912024-08-28T04:13:07.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88922024-08-28T04:13:07.486ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88932024-08-28T04:13:07.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88942024-08-28T04:13:07.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88952024-08-28T04:13:07.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88962024-08-28T04:13:07.496ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 438.724677ms iteration = 16 status = {}
88972024-08-28T04:13:09.138ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:64301
88982024-08-28T04:13:09.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64301 req_id = 14b79418-a3ec-4614-9e92-19c1d47a2aab roles = RoleSet { roles: {} } uri = /metrics/producers
88992024-08-28T04:13:09.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64301 req_id = 14b79418-a3ec-4614-9e92-19c1d47a2aab resource = Database result = Ok(()) uri = /metrics/producers
89002024-08-28T04:13:09.179ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
89012024-08-28T04:13:09.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64301 req_id = 14b79418-a3ec-4614-9e92-19c1d47a2aab roles = RoleSet { roles: {} } uri = /metrics/producers
89022024-08-28T04:13:09.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64301 req_id = 14b79418-a3ec-4614-9e92-19c1d47a2aab resource = Database result = Ok(()) uri = /metrics/producers
89032024-08-28T04:13:09.217ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
89042024-08-28T04:13:09.217ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "89c19f68-b790-453b-97f9-78504c227b62", "date": "Wed, 28 Aug 2024 04:13:09 GMT"} })
89052024-08-28T04:13:09.217ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 84f8f69b-1de3-4c63-8327-f221abc8d62f
89062024-08-28T04:13:09.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 80669 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64301 req_id = 14b79418-a3ec-4614-9e92-19c1d47a2aab response_code = 201 uri = /metrics/producers
89072024-08-28T04:13:11.271ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1258 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 74bda578-6375-4fdb-bb98-5fc7fb5be6c9 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
89082024-08-28T04:13:17.058ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
89092024-08-28T04:13:17.058ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
89102024-08-28T04:13:17.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89112024-08-28T04:13:17.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89122024-08-28T04:13:17.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89132024-08-28T04:13:17.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89142024-08-28T04:13:17.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89152024-08-28T04:13:17.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89162024-08-28T04:13:17.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89172024-08-28T04:13:17.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89182024-08-28T04:13:17.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89192024-08-28T04:13:17.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.534723ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89202024-08-28T04:13:17.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89212024-08-28T04:13:17.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89222024-08-28T04:13:17.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89232024-08-28T04:13:17.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89242024-08-28T04:13:17.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
89252024-08-28T04:13:17.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89262024-08-28T04:13:17.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89272024-08-28T04:13:17.077ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
89282024-08-28T04:13:17.077ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.669829ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
89292024-08-28T04:13:21.271ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1250 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = caf83083-01b2-49ba-8d7d-3180a8911b44 response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
89302024-08-28T04:13:21.273ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
89312024-08-28T04:13:21.273ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
89322024-08-28T04:13:21.303ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
89332024-08-28T04:13:21.304ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:62729
89342024-08-28T04:13:21.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62729 req_id = 2ab60c73-7cc7-4666-b589-8d38f5d1e37b roles = RoleSet { roles: {} } uri = /metrics/producers
89352024-08-28T04:13:21.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62729 req_id = 2ab60c73-7cc7-4666-b589-8d38f5d1e37b resource = Database result = Ok(()) uri = /metrics/producers
89362024-08-28T04:13:21.339ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 21378de4-15c3-48e2-b919-b1cc2363c4a6
89372024-08-28T04:13:21.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62729 req_id = 2ab60c73-7cc7-4666-b589-8d38f5d1e37b roles = RoleSet { roles: {} } uri = /metrics/producers
89382024-08-28T04:13:21.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62729 req_id = 2ab60c73-7cc7-4666-b589-8d38f5d1e37b resource = Database result = Ok(()) uri = /metrics/producers
89392024-08-28T04:13:21.373ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 uri = http://[fd00:1122:3344:101::d]:12223/producers
89402024-08-28T04:13:21.374ZDEBGnexus: client response oximeter-collector = 21378de4-15c3-48e2-b919-b1cc2363c4a6 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d6304fa8-1196-4ab4-86d5-80b752e8bbde", "date": "Wed, 28 Aug 2024 04:13:21 GMT"} })
89412024-08-28T04:13:21.374ZINFOnexus: assigned collector to new producer collector_id = 21378de4-15c3-48e2-b919-b1cc2363c4a6 file = nexus/src/app/oximeter.rs:125 producer_id = 1c6ee351-cab6-4c23-8658-c31bac40b40a
89422024-08-28T04:13:21.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 71206 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62729 req_id = 2ab60c73-7cc7-4666-b589-8d38f5d1e37b response_code = 201 uri = /metrics/producers
89432024-08-28T04:13:21.375ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "2ab60c73-7cc7-4666-b589-8d38f5d1e37b", "content-length": "41", "date": "Wed, 28 Aug 2024 04:13:21 GMT"} })
89442024-08-28T04:13:21.377ZDEBGnexus (producer-registration-task): registered with nexus successfully
89452024-08-28T04:13:21.377ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
89462024-08-28T04:13:27.058ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
89472024-08-28T04:13:27.058ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
89482024-08-28T04:13:27.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89492024-08-28T04:13:27.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89502024-08-28T04:13:27.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89512024-08-28T04:13:27.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89522024-08-28T04:13:27.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89532024-08-28T04:13:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89542024-08-28T04:13:27.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89552024-08-28T04:13:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89562024-08-28T04:13:27.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89572024-08-28T04:13:27.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89582024-08-28T04:13:27.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89592024-08-28T04:13:27.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89602024-08-28T04:13:27.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.234309ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89612024-08-28T04:13:27.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89622024-08-28T04:13:27.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
89632024-08-28T04:13:27.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89642024-08-28T04:13:27.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89652024-08-28T04:13:27.103ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
89662024-08-28T04:13:27.104ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.900629ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
89672024-08-28T04:13:31.376ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1336 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 7aa40f20-7359-47ff-9e87-5aa3b28a4ddc response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a
89682024-08-28T04:13:37.058ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
89692024-08-28T04:13:37.058ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
89702024-08-28T04:13:37.058ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
89712024-08-28T04:13:37.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89722024-08-28T04:13:37.058ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
89732024-08-28T04:13:37.058ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
89742024-08-28T04:13:37.058ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89752024-08-28T04:13:37.058ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89762024-08-28T04:13:37.058ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
89772024-08-28T04:13:37.058ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
89782024-08-28T04:13:37.058ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
89792024-08-28T04:13:37.058ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 04:03:37.058823011 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
89802024-08-28T04:13:37.058ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
89812024-08-28T04:13:37.058ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
89822024-08-28T04:13:37.058ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
89832024-08-28T04:13:37.058ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89842024-08-28T04:13:37.058ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
89852024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
89862024-08-28T04:13:37.059ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
89872024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89882024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
89892024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89902024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
89912024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
89922024-08-28T04:13:37.059ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
89932024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
89942024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
89952024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89962024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89972024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
89982024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89992024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90002024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
90012024-08-28T04:13:37.059ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
90022024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
90032024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90042024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
90052024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90062024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
90072024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
90082024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
90092024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
90102024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90112024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
90122024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
90132024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
90142024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90152024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90162024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
90172024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90182024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90192024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
90202024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
90212024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
90222024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90232024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
90242024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90252024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
90262024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
90272024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90282024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
90292024-08-28T04:13:37.059ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764
90302024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
90312024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
90322024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.221\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764"}
90332024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90342024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
90352024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90362024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90372024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
90382024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
90392024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
90402024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90412024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
90422024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90432024-08-28T04:13:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90442024-08-28T04:13:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90452024-08-28T04:13:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90462024-08-28T04:13:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90472024-08-28T04:13:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90482024-08-28T04:13:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90492024-08-28T04:13:37.060ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("037b07ce-9e39-4982-8c20-c4c38f448b97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4e2ba65e-422a-4b1e-b0e3-85f8149a979a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ae14950e-2bd4-4553-99b0-6488a03a8f3f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 146262409 } })
90502024-08-28T04:13:37.060ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4eb364e4-14a2-46c4-b173-eb2890920e8f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("94b35d7a-af71-4078-a57c-874ff9a27068.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 146422244 } })
90512024-08-28T04:13:37.061ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
90522024-08-28T04:13:37.062ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.202454ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
90532024-08-28T04:13:37.063ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
90542024-08-28T04:13:37.063ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.724299ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
90552024-08-28T04:13:37.067ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90562024-08-28T04:13:37.067ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90572024-08-28T04:13:37.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90582024-08-28T04:13:37.069ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 04:03:37.058823011 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
90592024-08-28T04:13:37.069ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.57283ms iteration = 9 status = {"expiration":"2024-08-28T04:03:37.058823011Z","pruned":[]}
90602024-08-28T04:13:37.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90612024-08-28T04:13:37.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90622024-08-28T04:13:37.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90632024-08-28T04:13:37.073ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 159688304 } })
90642024-08-28T04:13:37.075ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
90652024-08-28T04:13:37.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90662024-08-28T04:13:37.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90672024-08-28T04:13:37.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90682024-08-28T04:13:37.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90692024-08-28T04:13:37.082ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90702024-08-28T04:13:37.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90712024-08-28T04:13:37.083ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 169617785 } })
90722024-08-28T04:13:37.084ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
90732024-08-28T04:13:37.085ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 25.992693ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
90742024-08-28T04:13:37.086ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 26.723055ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
90752024-08-28T04:13:37.087ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90762024-08-28T04:13:37.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90772024-08-28T04:13:37.088ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90782024-08-28T04:13:37.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90792024-08-28T04:13:37.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90802024-08-28T04:13:37.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
90812024-08-28T04:13:37.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90822024-08-28T04:13:37.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90832024-08-28T04:13:37.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90842024-08-28T04:13:37.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8662c4be-d3e6-4ca8-a84c-46937c082764, lookup_type: ById(8662c4be-d3e6-4ca8-a84c-46937c082764) } result = Ok(())
90852024-08-28T04:13:37.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90862024-08-28T04:13:37.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90872024-08-28T04:13:37.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90882024-08-28T04:13:37.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90892024-08-28T04:13:37.116ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.251872ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
90902024-08-28T04:13:37.129ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
90912024-08-28T04:13:37.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90922024-08-28T04:13:37.135ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90932024-08-28T04:13:37.135ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90942024-08-28T04:13:37.135ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90952024-08-28T04:13:37.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90962024-08-28T04:13:37.137ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90972024-08-28T04:13:37.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90982024-08-28T04:13:37.137ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90992024-08-28T04:13:37.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91002024-08-28T04:13:37.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
91012024-08-28T04:13:37.139ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 original_time_created = 2024-08-28 04:05:16.457034 UTC target_id = 8662c4be-d3e6-4ca8-a84c-46937c082764 time_created = 2024-08-28 04:05:16.457034 UTC
91022024-08-28T04:13:37.139ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.620308ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8662c4be-d3e6-4ca8-a84c-46937c082764","time_created":"2024-08-28T04:05:16.457034Z"}
91032024-08-28T04:13:37.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
91042024-08-28T04:13:37.139ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
91052024-08-28T04:13:37.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
91062024-08-28T04:13:37.140ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
91072024-08-28T04:13:37.140ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
91082024-08-28T04:13:37.140ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
91092024-08-28T04:13:37.140ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91102024-08-28T04:13:37.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
91112024-08-28T04:13:37.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
91122024-08-28T04:13:37.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91132024-08-28T04:13:37.141ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91142024-08-28T04:13:37.141ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91152024-08-28T04:13:37.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91162024-08-28T04:13:37.141ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
91172024-08-28T04:13:37.141ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
91182024-08-28T04:13:37.141ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 82.624827ms iteration = 9 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
91192024-08-28T04:13:37.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
91202024-08-28T04:13:37.142ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91212024-08-28T04:13:37.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91222024-08-28T04:13:37.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91232024-08-28T04:13:37.142ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 83.791781ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
91242024-08-28T04:13:37.142ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.053689ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91252024-08-28T04:13:37.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
91262024-08-28T04:13:37.144ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91272024-08-28T04:13:37.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
91282024-08-28T04:13:37.147ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91292024-08-28T04:13:37.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91302024-08-28T04:13:37.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91312024-08-28T04:13:37.148ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91322024-08-28T04:13:37.148ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91332024-08-28T04:13:37.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
91342024-08-28T04:13:37.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
91352024-08-28T04:13:37.151ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91362024-08-28T04:13:37.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91372024-08-28T04:13:37.152ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91382024-08-28T04:13:37.152ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f62e5a13-51f3-4379-acf3-2f8e8601ac1f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 238631112 } })
91392024-08-28T04:13:37.153ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
91402024-08-28T04:13:37.154ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91412024-08-28T04:13:37.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91422024-08-28T04:13:37.155ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91432024-08-28T04:13:37.155ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91442024-08-28T04:13:37.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91452024-08-28T04:13:37.158ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91462024-08-28T04:13:37.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
91472024-08-28T04:13:37.162ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91482024-08-28T04:13:37.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91492024-08-28T04:13:37.167ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91502024-08-28T04:13:37.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91512024-08-28T04:13:37.169ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91522024-08-28T04:13:37.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91532024-08-28T04:13:37.172ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91542024-08-28T04:13:37.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f62e5a13-51f3-4379-acf3-2f8e8601ac1f, lookup_type: ById(f62e5a13-51f3-4379-acf3-2f8e8601ac1f) } result = Ok(())
91552024-08-28T04:13:37.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91562024-08-28T04:13:37.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91572024-08-28T04:13:37.176ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 117.370568ms iteration = 17 status = 0
91582024-08-28T04:13:37.177ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
91592024-08-28T04:13:37.177ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
91602024-08-28T04:13:37.177ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.611914ms iteration = 17 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
91612024-08-28T04:13:37.186ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
91622024-08-28T04:13:37.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
91632024-08-28T04:13:37.189ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
91642024-08-28T04:13:37.189ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
91652024-08-28T04:13:37.189ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
91662024-08-28T04:13:37.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91672024-08-28T04:13:37.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91682024-08-28T04:13:37.191ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
91692024-08-28T04:13:37.191ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
91702024-08-28T04:13:37.191ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
91712024-08-28T04:13:37.191ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91722024-08-28T04:13:37.191ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
91732024-08-28T04:13:37.191ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
91742024-08-28T04:13:37.191ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 132.213203ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
91752024-08-28T04:13:37.191ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 132.121371ms iteration = 17 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
91762024-08-28T04:13:37.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91772024-08-28T04:13:37.204ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
91782024-08-28T04:13:37.204ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91792024-08-28T04:13:37.205ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7f4275b4-39f4-4b98-a130-c10d27d49cb4", "content-length": "26", "date": "Wed, 28 Aug 2024 04:13:37 GMT"} })
91802024-08-28T04:13:37.205ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91812024-08-28T04:13:37.205ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91822024-08-28T04:13:37.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91832024-08-28T04:13:37.207ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91842024-08-28T04:13:37.209ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91852024-08-28T04:13:37.211ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
91862024-08-28T04:13:37.211ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91872024-08-28T04:13:37.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91882024-08-28T04:13:37.214ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
91892024-08-28T04:13:37.231ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91902024-08-28T04:13:37.233ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
91912024-08-28T04:13:37.233ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 173.712663ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
91922024-08-28T04:13:37.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
91932024-08-28T04:13:37.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91942024-08-28T04:13:37.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91952024-08-28T04:13:37.238ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
91962024-08-28T04:13:37.238ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 179.991597ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
91972024-08-28T04:13:37.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91982024-08-28T04:13:37.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91992024-08-28T04:13:37.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92002024-08-28T04:13:37.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
92012024-08-28T04:13:37.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92022024-08-28T04:13:37.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92032024-08-28T04:13:37.258ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T04:05:35.065116Z, time_modified: 2024-08-28T04:05:35.065116Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e3abc6f9-763c-486e-9205-7ca93e3777ea, db_silo: Silo { identity: SiloIdentity { id: e3abc6f9-763c-486e-9205-7ca93e3777ea, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T04:05:50.075083Z, time_modified: 2024-08-28T04:05:50.075083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483" }] }) }
92042024-08-28T04:13:37.258ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 198.579623ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]}},"default_endpoint":{"silo_id":"e3abc6f9-763c-486e-9205-7ca93e3777ea","tls_certs":["301187a297ab5e657d74dca72ce644684f1ebfaf22691de2170c9c94526da483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
92052024-08-28T04:13:37.270ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 211.41014ms iteration = 19 status = {"physical_disks_added":0}
92062024-08-28T04:13:37.327ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
92072024-08-28T04:13:37.333ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 zone_address = fd00:1122:3344:101::2
92082024-08-28T04:13:37.333ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92092024-08-28T04:13:37.334ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4dfd340e-3272-4f8a-97b5-5da3a90b726f", "content-length": "26", "date": "Wed, 28 Aug 2024 04:13:37 GMT"} })
92102024-08-28T04:13:37.334ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92112024-08-28T04:13:37.336ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
92122024-08-28T04:13:37.362ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
92132024-08-28T04:13:37.362ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92142024-08-28T04:13:37.362ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1298d2fc-f65f-4d9d-acee-c71a2da2bdf8", "content-length": "26", "date": "Wed, 28 Aug 2024 04:13:37 GMT"} })
92152024-08-28T04:13:37.362ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92162024-08-28T04:13:37.364ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92172024-08-28T04:13:37.386ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92182024-08-28T04:13:37.388ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1489d333-8008-4a2d-9b3a-2b571d61829e", "content-length": "372", "date": "Wed, 28 Aug 2024 04:13:37 GMT"} })
92192024-08-28T04:13:37.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92202024-08-28T04:13:37.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92212024-08-28T04:13:37.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92222024-08-28T04:13:37.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92232024-08-28T04:13:37.398ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92242024-08-28T04:13:37.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92252024-08-28T04:13:37.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92262024-08-28T04:13:37.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92272024-08-28T04:13:37.400ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92282024-08-28T04:13:37.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92292024-08-28T04:13:37.402ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92302024-08-28T04:13:37.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92312024-08-28T04:13:37.402ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92322024-08-28T04:13:37.403ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "929356a6-eb59-491f-aae2-fba2f3abe822", "date": "Wed, 28 Aug 2024 04:13:37 GMT"} })
92332024-08-28T04:13:37.403ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92342024-08-28T04:13:37.404ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 345.012315ms iteration = 18 status = {}
92352024-08-28T04:13:37.405ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92362024-08-28T04:13:37.405ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92372024-08-28T04:13:37.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92382024-08-28T04:13:37.415ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
92392024-08-28T04:13:37.415ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
92402024-08-28T04:13:37.415ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92412024-08-28T04:13:37.415ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
92422024-08-28T04:13:37.415ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 0 version = 2
92432024-08-28T04:13:37.416ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92442024-08-28T04:13:37.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92452024-08-28T04:13:37.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92462024-08-28T04:13:37.448ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92472024-08-28T04:13:37.451ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92482024-08-28T04:13:37.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92492024-08-28T04:13:37.451ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92502024-08-28T04:13:37.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92512024-08-28T04:13:37.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
92522024-08-28T04:13:37.454ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92532024-08-28T04:13:37.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92542024-08-28T04:13:37.455ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 53f5c2b0-2df4-4534-9c2c-3d7a38cb93c3 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
92552024-08-28T04:13:37.455ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
92562024-08-28T04:13:37.455ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 04:05:49.286960 UTC dns_group = internal generation = 1
92572024-08-28T04:13:37.455ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 395.451966ms iteration = 10 status = {"generation":1}
92582024-08-28T04:13:37.456ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 5406c80c-afc9-4411-9961-d7058971041d dns_zone_name = oxide.test found_so_far = 1 version = 2
92592024-08-28T04:13:37.456ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
92602024-08-28T04:13:37.456ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 04:05:50.133665 UTC dns_group = external generation = 2
92612024-08-28T04:13:37.456ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 397.61095ms iteration = 10 status = {"generation":2}
92622024-08-28T04:13:37.497ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
92632024-08-28T04:13:37.497ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2baba26a-5f06-494e-92b6-3d6fd280e6d1", "date": "Wed, 28 Aug 2024 04:13:36 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
92642024-08-28T04:13:37.497ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
92652024-08-28T04:13:37.499ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1150c4e5-7565-4233-ab06-4f67dcf8d3d3", "date": "Wed, 28 Aug 2024 04:13:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
92662024-08-28T04:13:37.499ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
92672024-08-28T04:13:37.500ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
92682024-08-28T04:13:37.500ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 441.932851ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
92692024-08-28T04:13:37.517ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
92702024-08-28T04:13:37.517ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "816b8d55-861a-49a1-9816-59b23ebc1aaa", "content-length": "2", "date": "Wed, 28 Aug 2024 04:13:36 GMT"} })
92712024-08-28T04:13:37.520ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 460.847667ms iteration = 17 status = {}
92722024-08-28T04:13:37.520ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92732024-08-28T04:13:37.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92742024-08-28T04:13:37.527ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
92752024-08-28T04:13:37.578ZDEBGnexus (BackgroundTasks): client request SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
92762024-08-28T04:13:37.579ZDEBGnexus (BackgroundTasks): client response SledAgent = f62e5a13-51f3-4379-acf3-2f8e8601ac1f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "69df171b-bf83-41f6-a541-6f990e2aa599", "content-length": "691", "date": "Wed, 28 Aug 2024 04:13:37 GMT"} })
92772024-08-28T04:13:37.579ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
92782024-08-28T04:13:37.579ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
92792024-08-28T04:13:37.579ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
92802024-08-28T04:13:37.580ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 520.85884ms iteration = 17 status = null
92812024-08-28T04:13:37.581ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 521.55ms iteration = 17 status = {}
92822024-08-28T04:13:37.605ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
92832024-08-28T04:13:37.606ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "109309ee-0506-4a46-b80d-46f39017bb5d", "date": "Wed, 28 Aug 2024 04:13:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92842024-08-28T04:13:37.606ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92852024-08-28T04:13:37.607ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "305caed3-3629-4e84-b881-03e09e9b2ff8", "date": "Wed, 28 Aug 2024 04:13:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92862024-08-28T04:13:37.607ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92872024-08-28T04:13:37.609ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f09ec98f-4acc-4749-9d2a-b9f08189d7ce", "date": "Wed, 28 Aug 2024 04:13:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92882024-08-28T04:13:37.609ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92892024-08-28T04:13:37.611ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92902024-08-28T04:13:37.611ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 552.826888ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
92912024-08-28T04:13:37.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92922024-08-28T04:13:37.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92932024-08-28T04:13:37.634ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 21872882-9c7e-4a12-8d80-3d3b1686a012, rack_id: 8b05f6f6-ff29-4d8c-aa09-514d34e6a880, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(726f0c10-a692-46cf-962b-4ac9a2a107fc) } rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
92942024-08-28T04:13:37.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92952024-08-28T04:13:37.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92962024-08-28T04:13:37.643ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
92972024-08-28T04:13:37.644ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bdd56550-0b6b-4c9c-a68f-5fc7c6644906", "content-length": "121", "date": "Wed, 28 Aug 2024 04:13:37 GMT"} })
92982024-08-28T04:13:37.644ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
92992024-08-28T04:13:37.644ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 726f0c10-a692-46cf-962b-4ac9a2a107fc
93002024-08-28T04:13:37.644ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
93012024-08-28T04:13:37.644ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
93022024-08-28T04:13:37.644ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
93032024-08-28T04:13:37.644ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 routes = {}
93042024-08-28T04:13:37.644ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880
93052024-08-28T04:13:37.644ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93062024-08-28T04:13:37.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93072024-08-28T04:13:37.646ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
93082024-08-28T04:13:37.646ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "60c7b8b3-891f-4016-8bd8-d456210e26e0", "content-length": "2", "date": "Wed, 28 Aug 2024 04:13:37 GMT"} })
93092024-08-28T04:13:37.646ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
93102024-08-28T04:13:37.646ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "86a005bd-bcae-47a7-8f0c-f5eadfc7cf73", "content-length": "50", "date": "Wed, 28 Aug 2024 04:13:37 GMT"} })
93112024-08-28T04:13:37.646ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch_location = Switch0
93122024-08-28T04:13:37.646ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
93132024-08-28T04:13:37.810ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4f82c66b-4b07-4b04-a177-bd14ad1e104f", "date": "Wed, 28 Aug 2024 04:13:37 GMT"} })
93142024-08-28T04:13:37.810ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 switch = Switch0
93152024-08-28T04:13:37.810ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
93162024-08-28T04:13:37.811ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8b05f6f6-ff29-4d8c-aa09-514d34e6a880 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "87543898-7a3c-4899-b6f8-7e320d82f8ae", "content-length": "667", "date": "Wed, 28 Aug 2024 04:13:37 GMT"} })
93172024-08-28T04:13:37.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93182024-08-28T04:13:37.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93192024-08-28T04:13:37.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93202024-08-28T04:13:37.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93212024-08-28T04:13:37.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93222024-08-28T04:13:37.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93232024-08-28T04:13:37.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93242024-08-28T04:13:37.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93252024-08-28T04:13:37.829ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 770.189193ms iteration = 17 status = {}
93262024-08-28T04:13:41.376ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1202 local_addr = [fd00:1122:3344:101::b]:53641 method = GET remote_addr = [fd00:1122:3344:101::d]:33112 req_id = 57293eed-a567-43d9-b269-cb3d6dd484af response_code = 200 uri = /1c6ee351-cab6-4c23-8658-c31bac40b40a