Max level shown:
1 [ Nov 6 00:19:05 Enabled. ]
2 [ Nov 6 00:19:05 Rereading configuration. ]
3 [ Nov 6 00:19:07 Rereading configuration. ]
4 [ Nov 6 00:19:18 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Nov 6 00:19:18 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-11-06T00:19:19.054ZDEBGnexus: registered DTrace probes
82024-11-06T00:19:19.057ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:74
92024-11-06T00:19:19.066ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-11-06T00:19:19.066ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-11-06T00:19:19.066ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-11-06T00:19:19.066ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-11-06T00:19:19.066ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-11-06T00:19:19.066ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-11-06T00:19:19.066ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-11-06T00:19:19.066ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-11-06T00:19:19.066ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-11-06T00:19:19.066ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-11-06T00:19:19.066ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-11-06T00:19:19.066ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-11-06T00:19:19.066ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-11-06T00:19:19.066ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612024-11-06T00:19:19.067ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622024-11-06T00:19:19.067ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632024-11-06T00:19:19.083ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642024-11-06T00:19:19.086ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652024-11-06T00:19:19.089ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662024-11-06T00:19:19.097ZDEBGnexus (ServerContext): registered USDT probes
672024-11-06T00:19:19.305ZINFOnexus: Database schema version is up to date desired_version = 112.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 112.0.0
682024-11-06T00:19:19.308ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
692024-11-06T00:19:19.330ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1022, tv_nsec: 667820308 } })
702024-11-06T00:19:19.331ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1114
712024-11-06T00:19:19.379ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
722024-11-06T00:19:19.379ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732024-11-06T00:19:19.382ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f358af1a-dc7d-4266-b5ef-178aeb8db1d5", "content-length": "26", "date": "Wed, 06 Nov 2024 00:19:19 GMT"} })
742024-11-06T00:19:19.383ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752024-11-06T00:19:19.383ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762024-11-06T00:19:19.414ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1022, tv_nsec: 752397099 } })
772024-11-06T00:19:19.414ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1114
782024-11-06T00:19:19.446ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
792024-11-06T00:19:19.446ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802024-11-06T00:19:19.446ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a41e82d1-a9a4-4a1f-9c9c-753232c2807e", "content-length": "26", "date": "Wed, 06 Nov 2024 00:19:19 GMT"} })
812024-11-06T00:19:19.447ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822024-11-06T00:19:19.447ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832024-11-06T00:19:19.513ZDEBGnexus (clickhouse-client): registered USDT probes id = b9d74705-d79c-42ed-845c-7b38ee850e26
842024-11-06T00:19:19.513ZDEBGnexus (clickhouse-client): registered USDT probes id = b9d74705-d79c-42ed-845c-7b38ee850e26
852024-11-06T00:19:19.522ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
862024-11-06T00:19:19.533ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
872024-11-06T00:19:19.534ZDEBGnexus (DataLoader): attempting to create built-in users
882024-11-06T00:19:19.534ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
892024-11-06T00:19:19.534ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
902024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /artifacts/{kind}/{name}/{version}
912024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks
922024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /bgtasks/activate
932024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks/view/{bgtask_name}
942024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /clickhouse/policy
952024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /clickhouse/policy
962024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request
972024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped
982024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress
992024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish
1002024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start
1012024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga
1022024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete
1032024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all
1042024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id}
1052024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id}
1062024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/import
1072024-11-06T00:19:19.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/regenerate
1082024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/target
1092024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/target
1102024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /deployment/blueprints/target/enabled
1112024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent
1122024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /disks/{disk_id}
1132024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /instances/{instance_id}/migrate
1142024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/collectors
1152024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /metrics/collectors/{collector_id}/producers
1162024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/producers
1172024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /nat/ipv4/changeset/{from_gen}
1182024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /physical-disk/expunge
1192024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /probes/{sled}
1202024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /racks/{rack_id}/initialization-complete
1212024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas
1222024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas/{saga_id}
1232024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sled-agents/{sled_id}
1242024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}
1252024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update
1262024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/add
1272024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/expunge
1282024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sleds/uninitialized
1292024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /switch/{switch_id}
1302024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /vmms/{propolis_id}
1312024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent
1322024-11-06T00:19:19.550ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::b]:12221
1332024-11-06T00:19:19.550ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12221
1342024-11-06T00:19:19.550ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1352024-11-06T00:19:19.550ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1362024-11-06T00:19:19.696ZINFOnexus (DataLoader): created 5 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1372024-11-06T00:19:19.696ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1382024-11-06T00:19:19.697ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1392024-11-06T00:19:19.698ZDEBGnexus (DataLoader): attempting to create built-in roles
1402024-11-06T00:19:19.698ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1412024-11-06T00:19:19.699ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1422024-11-06T00:19:19.792ZINFOnexus (DataLoader): created 10 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1432024-11-06T00:19:19.792ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1442024-11-06T00:19:19.793ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1452024-11-06T00:19:19.793ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1462024-11-06T00:19:19.793ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1472024-11-06T00:19:19.793ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1482024-11-06T00:19:20.178ZWARNnexus: Cannot look up rack: Object (of type ById(3a58cbfb-5015-41c2-9142-616f1a1558aa)) not found: rack file = nexus/src/app/rack.rs:771
1492024-11-06T00:19:20.855ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:64826
1502024-11-06T00:19:20.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = d34d7dc7-0ffc-40e8-a07c-ea01efc68fa5 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
1512024-11-06T00:19:20.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = d34d7dc7-0ffc-40e8-a07c-ea01efc68fa5 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
1522024-11-06T00:19:21.472ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:33037
1532024-11-06T00:19:21.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33037 req_id = 75fe0353-4b31-4bcb-91e8-1e371d8d070e roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
1542024-11-06T00:19:21.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33037 req_id = 75fe0353-4b31-4bcb-91e8-1e371d8d070e resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
1552024-11-06T00:19:21.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33037 req_id = 75fe0353-4b31-4bcb-91e8-1e371d8d070e response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
1562024-11-06T00:19:22.180ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1572024-11-06T00:19:22.180ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1582024-11-06T00:19:22.251ZWARNnexus: Cannot look up rack: Object (of type ById(3a58cbfb-5015-41c2-9142-616f1a1558aa)) not found: rack file = nexus/src/app/rack.rs:771
1592024-11-06T00:19:22.721ZINFOnexus (DataLoader): created 4 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1602024-11-06T00:19:22.721ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1612024-11-06T00:19:22.722ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1622024-11-06T00:19:22.722ZDEBGnexus (DataLoader): attempting to create built-in silos
1632024-11-06T00:19:22.722ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1642024-11-06T00:19:22.722ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1652024-11-06T00:19:23.066ZINFOnexus (DataLoader): created 2 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1662024-11-06T00:19:23.066ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1672024-11-06T00:19:23.066ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1682024-11-06T00:19:23.120ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1692024-11-06T00:19:23.121ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1702024-11-06T00:19:23.121ZDEBGnexus (DataLoader): attempting to create built-in projects
1712024-11-06T00:19:23.121ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1722024-11-06T00:19:23.121ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1732024-11-06T00:19:23.149ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1742024-11-06T00:19:23.149ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1752024-11-06T00:19:23.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = d34d7dc7-0ffc-40e8-a07c-ea01efc68fa5 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
1762024-11-06T00:19:23.181ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = d34d7dc7-0ffc-40e8-a07c-ea01efc68fa5 resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
1772024-11-06T00:19:23.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = d34d7dc7-0ffc-40e8-a07c-ea01efc68fa5 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
1782024-11-06T00:19:23.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = d34d7dc7-0ffc-40e8-a07c-ea01efc68fa5 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
1792024-11-06T00:19:23.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = d34d7dc7-0ffc-40e8-a07c-ea01efc68fa5 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
1802024-11-06T00:19:23.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = d34d7dc7-0ffc-40e8-a07c-ea01efc68fa5 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
1812024-11-06T00:19:23.351ZINFOnexus (dropshot_internal): set cockroachdb setting actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:124 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = d34d7dc7-0ffc-40e8-a07c-ea01efc68fa5 setting = cluster.preserve_downgrade_option uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete value = 22.1
1822024-11-06T00:19:23.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = d34d7dc7-0ffc-40e8-a07c-ea01efc68fa5 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
1832024-11-06T00:19:23.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = d34d7dc7-0ffc-40e8-a07c-ea01efc68fa5 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
1842024-11-06T00:19:23.354ZINFOnexus (dropshot_internal): request completed error_message_external = not found: rack with id "3a58cbfb-5015-41c2-9142-616f1a1558aa" error_message_internal = not found: rack with id "3a58cbfb-5015-41c2-9142-616f1a1558aa" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 2499410 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = d34d7dc7-0ffc-40e8-a07c-ea01efc68fa5 response_code = 404 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
1852024-11-06T00:19:24.088ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1862024-11-06T00:19:24.089ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1872024-11-06T00:19:24.090ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1882024-11-06T00:19:24.092ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1892024-11-06T00:19:24.092ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1902024-11-06T00:19:24.092ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1912024-11-06T00:19:24.131ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1922024-11-06T00:19:24.131ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1932024-11-06T00:19:24.164ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1942024-11-06T00:19:24.165ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1952024-11-06T00:19:24.165ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1962024-11-06T00:19:24.166ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1972024-11-06T00:19:24.252ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1982024-11-06T00:19:24.252ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1992024-11-06T00:19:24.255ZWARNnexus: Cannot look up rack: Object (of type ById(3a58cbfb-5015-41c2-9142-616f1a1558aa)) not found: rack file = nexus/src/app/rack.rs:771
2002024-11-06T00:19:24.317ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
2012024-11-06T00:19:24.317ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2022024-11-06T00:19:24.318ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2032024-11-06T00:19:24.318ZDEBGnexus (DataLoader): attempting to create built-in VPCs
2042024-11-06T00:19:24.318ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2052024-11-06T00:19:24.318ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2062024-11-06T00:19:24.340ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2072024-11-06T00:19:24.340ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2082024-11-06T00:19:24.373ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2092024-11-06T00:19:24.373ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2102024-11-06T00:19:24.379ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2112024-11-06T00:19:24.379ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2122024-11-06T00:19:24.380ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2132024-11-06T00:19:24.380ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2142024-11-06T00:19:24.409ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2152024-11-06T00:19:24.411ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2162024-11-06T00:19:24.411ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2172024-11-06T00:19:24.411ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2182024-11-06T00:19:24.415ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2192024-11-06T00:19:24.415ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2202024-11-06T00:19:24.416ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2212024-11-06T00:19:24.417ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2222024-11-06T00:19:24.418ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2232024-11-06T00:19:24.420ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2242024-11-06T00:19:24.420ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2252024-11-06T00:19:24.420ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2262024-11-06T00:19:24.454ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2272024-11-06T00:19:24.454ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2282024-11-06T00:19:24.455ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2292024-11-06T00:19:24.455ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2302024-11-06T00:19:24.457ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2312024-11-06T00:19:24.457ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2322024-11-06T00:19:24.458ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2332024-11-06T00:19:24.461ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2342024-11-06T00:19:24.461ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2352024-11-06T00:19:24.461ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2362024-11-06T00:19:24.481ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2372024-11-06T00:19:24.481ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2382024-11-06T00:19:24.512ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2392024-11-06T00:19:24.512ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2402024-11-06T00:19:24.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 06ee5dbc-8d40-4973-8b95-73fb82e78b30 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
2412024-11-06T00:19:24.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 06ee5dbc-8d40-4973-8b95-73fb82e78b30 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
2422024-11-06T00:19:24.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 06ee5dbc-8d40-4973-8b95-73fb82e78b30 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
2432024-11-06T00:19:24.519ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 06ee5dbc-8d40-4973-8b95-73fb82e78b30 resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
2442024-11-06T00:19:24.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 06ee5dbc-8d40-4973-8b95-73fb82e78b30 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
2452024-11-06T00:19:24.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 06ee5dbc-8d40-4973-8b95-73fb82e78b30 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
2462024-11-06T00:19:24.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 06ee5dbc-8d40-4973-8b95-73fb82e78b30 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
2472024-11-06T00:19:24.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 06ee5dbc-8d40-4973-8b95-73fb82e78b30 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
2482024-11-06T00:19:24.523ZINFOnexus (dropshot_internal): request completed error_message_external = not found: rack with id "3a58cbfb-5015-41c2-9142-616f1a1558aa" error_message_internal = not found: rack with id "3a58cbfb-5015-41c2-9142-616f1a1558aa" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 7588 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 06ee5dbc-8d40-4973-8b95-73fb82e78b30 response_code = 404 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
2492024-11-06T00:19:24.535ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2502024-11-06T00:19:24.536ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2512024-11-06T00:19:24.537ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2522024-11-06T00:19:24.537ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2532024-11-06T00:19:24.539ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2542024-11-06T00:19:24.539ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2552024-11-06T00:19:24.540ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2562024-11-06T00:19:24.541ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2572024-11-06T00:19:24.542ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2582024-11-06T00:19:24.542ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2592024-11-06T00:19:24.543ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2602024-11-06T00:19:24.547ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2612024-11-06T00:19:24.547ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2622024-11-06T00:19:24.547ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2632024-11-06T00:19:24.548ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2642024-11-06T00:19:24.548ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2652024-11-06T00:19:24.549ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2662024-11-06T00:19:24.550ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2672024-11-06T00:19:24.551ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2682024-11-06T00:19:24.554ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2692024-11-06T00:19:24.554ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2702024-11-06T00:19:24.554ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2712024-11-06T00:19:24.644ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2722024-11-06T00:19:24.644ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2732024-11-06T00:19:24.646ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2742024-11-06T00:19:24.646ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2752024-11-06T00:19:24.647ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2762024-11-06T00:19:24.648ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2772024-11-06T00:19:24.649ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2782024-11-06T00:19:24.652ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2792024-11-06T00:19:24.652ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2802024-11-06T00:19:24.653ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2812024-11-06T00:19:24.736ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2822024-11-06T00:19:24.736ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2832024-11-06T00:19:24.737ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2842024-11-06T00:19:24.752ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2852024-11-06T00:19:24.752ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2862024-11-06T00:19:24.754ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872024-11-06T00:19:24.754ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2882024-11-06T00:19:24.756ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892024-11-06T00:19:24.756ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2902024-11-06T00:19:24.758ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2912024-11-06T00:19:24.758ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2922024-11-06T00:19:24.759ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2932024-11-06T00:19:24.760ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2942024-11-06T00:19:24.763ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2952024-11-06T00:19:24.767ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2962024-11-06T00:19:24.767ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972024-11-06T00:19:24.767ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2982024-11-06T00:19:24.768ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992024-11-06T00:19:24.768ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3002024-11-06T00:19:24.769ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012024-11-06T00:19:24.769ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3022024-11-06T00:19:24.771ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3032024-11-06T00:19:24.774ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3042024-11-06T00:19:24.774ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3052024-11-06T00:19:24.774ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3062024-11-06T00:19:24.843ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3072024-11-06T00:19:24.843ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3082024-11-06T00:19:24.844ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3092024-11-06T00:19:24.844ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3102024-11-06T00:19:24.845ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3112024-11-06T00:19:24.846ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3122024-11-06T00:19:24.847ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3132024-11-06T00:19:24.850ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3142024-11-06T00:19:24.850ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3152024-11-06T00:19:24.850ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3162024-11-06T00:19:24.929ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:282
3172024-11-06T00:19:24.929ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
3182024-11-06T00:19:24.929ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3192024-11-06T00:19:24.929ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3202024-11-06T00:19:24.949ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3212024-11-06T00:19:24.950ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3222024-11-06T00:19:24.951ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3232024-11-06T00:19:24.951ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3242024-11-06T00:19:24.953ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3252024-11-06T00:19:24.953ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3262024-11-06T00:19:24.954ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3272024-11-06T00:19:24.954ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3282024-11-06T00:19:24.955ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3292024-11-06T00:19:24.956ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3302024-11-06T00:19:24.957ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3312024-11-06T00:19:24.960ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3322024-11-06T00:19:24.960ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3332024-11-06T00:19:24.960ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3342024-11-06T00:19:24.962ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3352024-11-06T00:19:24.963ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3362024-11-06T00:19:24.964ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3372024-11-06T00:19:24.964ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3382024-11-06T00:19:24.965ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3392024-11-06T00:19:24.966ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3402024-11-06T00:19:24.967ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3412024-11-06T00:19:24.967ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3422024-11-06T00:19:24.968ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3432024-11-06T00:19:24.969ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3442024-11-06T00:19:24.970ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3452024-11-06T00:19:24.970ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3462024-11-06T00:19:24.971ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3472024-11-06T00:19:24.975ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
3482024-11-06T00:19:24.975ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3492024-11-06T00:19:24.975ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3502024-11-06T00:19:24.976ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3512024-11-06T00:19:24.977ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3522024-11-06T00:19:24.978ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3532024-11-06T00:19:24.978ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3542024-11-06T00:19:24.979ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3552024-11-06T00:19:24.980ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3562024-11-06T00:19:24.981ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3572024-11-06T00:19:24.983ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3582024-11-06T00:19:24.990ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:59038
3592024-11-06T00:19:24.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59038 req_id = 655b18ce-e038-43d4-b5ca-6cf922e7b546 roles = RoleSet { roles: {} } uri = /metrics/producers
3602024-11-06T00:19:24.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59038 req_id = 655b18ce-e038-43d4-b5ca-6cf922e7b546 resource = Database result = Ok(()) uri = /metrics/producers
3612024-11-06T00:19:25.019ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3622024-11-06T00:19:25.020ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3632024-11-06T00:19:25.096ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3642024-11-06T00:19:25.097ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3652024-11-06T00:19:25.104ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = a6ef5eb9-ed97-44f5-b038-ae216d3973fd
3662024-11-06T00:19:25.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112885 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59038 req_id = 655b18ce-e038-43d4-b5ca-6cf922e7b546 response_code = 201 uri = /metrics/producers
3672024-11-06T00:19:25.112ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3682024-11-06T00:19:25.113ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3692024-11-06T00:19:25.114ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3702024-11-06T00:19:25.114ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3712024-11-06T00:19:25.115ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3722024-11-06T00:19:25.116ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3732024-11-06T00:19:25.117ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3742024-11-06T00:19:25.120ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3752024-11-06T00:19:25.120ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3762024-11-06T00:19:25.120ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3772024-11-06T00:19:25.185ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3782024-11-06T00:19:25.185ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3792024-11-06T00:19:25.187ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3802024-11-06T00:19:25.187ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3812024-11-06T00:19:25.191ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3822024-11-06T00:19:25.191ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3832024-11-06T00:19:25.192ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3842024-11-06T00:19:25.193ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3852024-11-06T00:19:25.195ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3862024-11-06T00:19:25.198ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3872024-11-06T00:19:25.272ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3882024-11-06T00:19:25.273ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3892024-11-06T00:19:25.310ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3902024-11-06T00:19:25.310ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3912024-11-06T00:19:25.327ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3922024-11-06T00:19:25.327ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3932024-11-06T00:19:25.328ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3942024-11-06T00:19:25.328ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3952024-11-06T00:19:25.330ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3962024-11-06T00:19:25.331ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3972024-11-06T00:19:25.332ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3982024-11-06T00:19:25.336ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3992024-11-06T00:19:25.336ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4002024-11-06T00:19:25.337ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4012024-11-06T00:19:25.354ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:346
4022024-11-06T00:19:25.354ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:224
4032024-11-06T00:19:25.354ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4042024-11-06T00:19:25.355ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4052024-11-06T00:19:25.355ZDEBGnexus (DataLoader): attempting to create silo users
4062024-11-06T00:19:25.355ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4072024-11-06T00:19:25.355ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4082024-11-06T00:19:25.393ZINFOnexus (DataLoader): created 0 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
4092024-11-06T00:19:25.393ZDEBGnexus (DataLoader): attempting to create silo user role assignments
4102024-11-06T00:19:25.393ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4112024-11-06T00:19:25.394ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4122024-11-06T00:19:25.405ZINFOnexus (DataLoader): created 0 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
4132024-11-06T00:19:25.405ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4142024-11-06T00:19:25.405ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4152024-11-06T00:19:25.418ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4162024-11-06T00:19:25.419ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4172024-11-06T00:19:25.430ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4182024-11-06T00:19:25.430ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4192024-11-06T00:19:25.432ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4202024-11-06T00:19:25.433ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
4212024-11-06T00:19:25.433ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4222024-11-06T00:19:25.433ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4232024-11-06T00:19:25.496ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4242024-11-06T00:19:25.496ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4252024-11-06T00:19:25.498ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4262024-11-06T00:19:25.499ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
4272024-11-06T00:19:25.499ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4282024-11-06T00:19:25.499ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4292024-11-06T00:19:25.774ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4302024-11-06T00:19:25.774ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4312024-11-06T00:19:25.802ZINFOnexus: populate complete file = nexus/src/app/mod.rs:538
4322024-11-06T00:19:25.802ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:547
4332024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
4342024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4352024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4362024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
4372024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4382024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4392024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4402024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
4412024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4422024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
4432024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
4442024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4452024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4462024-11-06T00:19:25.807ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4472024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
4482024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
4492024-11-06T00:19:25.807ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4502024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
4512024-11-06T00:19:25.807ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4522024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4532024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4542024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 12.721\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4552024-11-06T00:19:25.807ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4562024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
4572024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4582024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 170.575\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4592024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4602024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4612024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
4622024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4632024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4642024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4652024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
4662024-11-06T00:19:25.807ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
4672024-11-06T00:19:25.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4682024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4692024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4702024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4712024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4722024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 26.78\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4732024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4742024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4752024-11-06T00:19:25.808ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4762024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 3.9\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4772024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4782024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
4792024-11-06T00:19:25.808ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4802024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4812024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4822024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
4832024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4842024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4852024-11-06T00:19:25.808ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-06 00:09:25.807906701 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4862024-11-06T00:19:25.808ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4872024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4882024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4892024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 300.859\u{b5}s iteration = 1 status = {"errors":[],"records_set_to_done":[]}
4902024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4912024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.523\u{b5}s iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
4922024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4932024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4942024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4952024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4962024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4972024-11-06T00:19:25.808ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4982024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4992024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5002024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5012024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
5022024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5032024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5042024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5052024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5062024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5072024-11-06T00:19:25.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5082024-11-06T00:19:25.809ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("309c9aef-da72-4f08-9f70-c20d80316472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1029, tv_nsec: 146749781 } })
5092024-11-06T00:19:25.809ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51df9631-cef5-49ae-8cfd-f0c05bdac388.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7102227a-61f8-4dda-a9a0-f6678fae71c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1029, tv_nsec: 146550625 } })
5102024-11-06T00:19:25.809ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5112024-11-06T00:19:25.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 217.547\u{b5}s iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
5122024-11-06T00:19:25.810ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
5132024-11-06T00:19:25.810ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.890975ms iteration = 1 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
5142024-11-06T00:19:25.810ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
5152024-11-06T00:19:25.810ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5162024-11-06T00:19:25.810ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 3.78\u{b5}s iteration = 2 status = {"error":"no config"}
5172024-11-06T00:19:25.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5182024-11-06T00:19:25.810ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5192024-11-06T00:19:25.810ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5202024-11-06T00:19:25.810ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
5212024-11-06T00:19:25.810ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
5222024-11-06T00:19:25.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 2.902066ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
5232024-11-06T00:19:25.810ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.302339ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5242024-11-06T00:19:25.810ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
5252024-11-06T00:19:25.810ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5262024-11-06T00:19:25.810ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 7.86\u{b5}s iteration = 2 status = {"error":"no config"}
5272024-11-06T00:19:25.810ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5282024-11-06T00:19:25.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5292024-11-06T00:19:25.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5302024-11-06T00:19:25.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5312024-11-06T00:19:25.811ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
5322024-11-06T00:19:25.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5332024-11-06T00:19:25.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5342024-11-06T00:19:25.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5352024-11-06T00:19:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5362024-11-06T00:19:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5372024-11-06T00:19:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5382024-11-06T00:19:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5392024-11-06T00:19:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5402024-11-06T00:19:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5412024-11-06T00:19:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5422024-11-06T00:19:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5432024-11-06T00:19:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5442024-11-06T00:19:25.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1029, tv_nsec: 150493912 } })
5452024-11-06T00:19:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5462024-11-06T00:19:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5472024-11-06T00:19:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5482024-11-06T00:19:25.812ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5492024-11-06T00:19:25.812ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.803733ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5502024-11-06T00:19:25.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
5512024-11-06T00:19:25.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5522024-11-06T00:19:25.814ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5532024-11-06T00:19:25.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5542024-11-06T00:19:25.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5552024-11-06T00:19:25.815ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5562024-11-06T00:19:25.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5572024-11-06T00:19:25.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5582024-11-06T00:19:25.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5592024-11-06T00:19:25.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5602024-11-06T00:19:25.816ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5612024-11-06T00:19:25.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5622024-11-06T00:19:25.818ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5632024-11-06T00:19:25.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5642024-11-06T00:19:25.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5652024-11-06T00:19:25.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5662024-11-06T00:19:25.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5672024-11-06T00:19:25.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5682024-11-06T00:19:25.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5692024-11-06T00:19:25.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5702024-11-06T00:19:25.830ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.705954ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5712024-11-06T00:19:25.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5722024-11-06T00:19:25.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5732024-11-06T00:19:25.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5742024-11-06T00:19:25.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5752024-11-06T00:19:25.835ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5762024-11-06T00:19:25.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5772024-11-06T00:19:25.836ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5782024-11-06T00:19:25.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5792024-11-06T00:19:25.838ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 30.735493ms iteration = 1 status = {}
5802024-11-06T00:19:25.838ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
5812024-11-06T00:19:25.838ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 30.98315ms iteration = 1 status = {"error":"rack not yet initialized: 3a58cbfb-5015-41c2-9142-616f1a1558aa"}
5822024-11-06T00:19:25.841ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-06 00:09:25.807906701 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5832024-11-06T00:19:25.841ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 33.579137ms iteration = 1 status = {"expiration":"2024-11-06T00:09:25.807906701Z","pruned":[]}
5842024-11-06T00:19:25.843ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5852024-11-06T00:19:25.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5862024-11-06T00:19:25.847ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5872024-11-06T00:19:25.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5882024-11-06T00:19:25.851ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1029, tv_nsec: 189679576 } })
5892024-11-06T00:19:25.852ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
5902024-11-06T00:19:25.856ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5912024-11-06T00:19:25.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5922024-11-06T00:19:25.863ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
5932024-11-06T00:19:25.863ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5942024-11-06T00:19:25.864ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1ab9cf9-99ce-4940-9a4b-7f9b9c1ba872", "content-length": "26", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
5952024-11-06T00:19:25.864ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5962024-11-06T00:19:25.865ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5972024-11-06T00:19:25.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5982024-11-06T00:19:25.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5992024-11-06T00:19:25.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6002024-11-06T00:19:25.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6012024-11-06T00:19:25.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6022024-11-06T00:19:25.875ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6032024-11-06T00:19:25.875ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6042024-11-06T00:19:25.875ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6052024-11-06T00:19:25.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6062024-11-06T00:19:25.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6072024-11-06T00:19:25.878ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6082024-11-06T00:19:25.879ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6092024-11-06T00:19:25.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6102024-11-06T00:19:25.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
6112024-11-06T00:19:25.880ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6122024-11-06T00:19:25.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6132024-11-06T00:19:25.880ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6142024-11-06T00:19:25.880ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6152024-11-06T00:19:25.880ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6162024-11-06T00:19:25.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6172024-11-06T00:19:25.881ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
6182024-11-06T00:19:25.881ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6192024-11-06T00:19:25.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6202024-11-06T00:19:25.882ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6212024-11-06T00:19:25.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6222024-11-06T00:19:25.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6232024-11-06T00:19:25.883ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6242024-11-06T00:19:25.883ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6252024-11-06T00:19:25.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6262024-11-06T00:19:25.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6272024-11-06T00:19:25.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6282024-11-06T00:19:25.886ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
6292024-11-06T00:19:25.886ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.220283ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
6302024-11-06T00:19:25.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6312024-11-06T00:19:25.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6322024-11-06T00:19:25.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6332024-11-06T00:19:25.887ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
6342024-11-06T00:19:25.887ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 80.057747ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
6352024-11-06T00:19:25.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6362024-11-06T00:19:25.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6372024-11-06T00:19:25.889ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6382024-11-06T00:19:25.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6392024-11-06T00:19:25.891ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6402024-11-06T00:19:25.891ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6412024-11-06T00:19:25.891ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.963803ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6422024-11-06T00:19:25.904ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
6432024-11-06T00:19:25.904ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6442024-11-06T00:19:25.904ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6452024-11-06T00:19:25.904ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22f5321c-fc34-4da5-84fe-d563a16a396e", "content-length": "26", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
6462024-11-06T00:19:25.904ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6472024-11-06T00:19:25.905ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6482024-11-06T00:19:25.909ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6492024-11-06T00:19:25.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6502024-11-06T00:19:25.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6512024-11-06T00:19:25.910ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6522024-11-06T00:19:25.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6532024-11-06T00:19:25.913ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6542024-11-06T00:19:25.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6552024-11-06T00:19:25.915ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 107.243184ms iteration = 1 status = {}
6562024-11-06T00:19:25.916ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6572024-11-06T00:19:25.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6582024-11-06T00:19:25.917ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6592024-11-06T00:19:25.917ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6602024-11-06T00:19:25.917ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 109.419028ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6612024-11-06T00:19:25.917ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6622024-11-06T00:19:25.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6632024-11-06T00:19:25.921ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6642024-11-06T00:19:25.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6652024-11-06T00:19:25.934ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6662024-11-06T00:19:25.934ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6672024-11-06T00:19:25.934ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6682024-11-06T00:19:25.934ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 126.65177ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6692024-11-06T00:19:25.934ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 126.478515ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6702024-11-06T00:19:25.934ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6712024-11-06T00:19:25.934ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 126.65898ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6722024-11-06T00:19:25.934ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6732024-11-06T00:19:25.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6742024-11-06T00:19:25.935ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6752024-11-06T00:19:25.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6762024-11-06T00:19:25.936ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6772024-11-06T00:19:25.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6782024-11-06T00:19:25.938ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6792024-11-06T00:19:25.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6802024-11-06T00:19:25.940ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6812024-11-06T00:19:25.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6822024-11-06T00:19:25.941ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6832024-11-06T00:19:25.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6842024-11-06T00:19:25.943ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6852024-11-06T00:19:25.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6862024-11-06T00:19:25.944ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6872024-11-06T00:19:25.944ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6882024-11-06T00:19:25.944ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 137.033328ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6892024-11-06T00:19:25.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 140.295175ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6902024-11-06T00:19:25.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6912024-11-06T00:19:25.948ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6922024-11-06T00:19:25.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6932024-11-06T00:19:25.950ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6942024-11-06T00:19:25.950ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cb0383f-1dee-4079-9df1-e9875b848058", "content-length": "1", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
6952024-11-06T00:19:25.952ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6962024-11-06T00:19:25.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6972024-11-06T00:19:25.953ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6982024-11-06T00:19:25.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6992024-11-06T00:19:25.955ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7002024-11-06T00:19:25.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7012024-11-06T00:19:25.959ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7022024-11-06T00:19:25.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7032024-11-06T00:19:25.962ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7042024-11-06T00:19:25.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7052024-11-06T00:19:25.965ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7062024-11-06T00:19:25.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7072024-11-06T00:19:25.967ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7082024-11-06T00:19:25.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7092024-11-06T00:19:25.969ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7102024-11-06T00:19:25.972ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7112024-11-06T00:19:25.972ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7122024-11-06T00:19:25.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7132024-11-06T00:19:25.974ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7142024-11-06T00:19:25.974ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 166.787381ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7152024-11-06T00:19:25.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7162024-11-06T00:19:25.976ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7172024-11-06T00:19:25.976ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 168.168743ms iteration = 1 status = {}
7182024-11-06T00:19:25.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7192024-11-06T00:19:25.977ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7202024-11-06T00:19:25.981ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7212024-11-06T00:19:25.981ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7222024-11-06T00:19:25.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7232024-11-06T00:19:25.984ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7242024-11-06T00:19:25.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7252024-11-06T00:19:25.985ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7262024-11-06T00:19:25.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7272024-11-06T00:19:25.987ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7282024-11-06T00:19:25.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7292024-11-06T00:19:25.989ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7302024-11-06T00:19:25.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7312024-11-06T00:19:25.992ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7322024-11-06T00:19:25.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7332024-11-06T00:19:25.993ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
7342024-11-06T00:19:25.993ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 186.176237ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
7352024-11-06T00:19:25.993ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7362024-11-06T00:19:25.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7372024-11-06T00:19:25.995ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7382024-11-06T00:19:25.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7392024-11-06T00:19:25.996ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 188.61617ms iteration = 1 status = null
7402024-11-06T00:19:25.997ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7412024-11-06T00:19:26.000ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7422024-11-06T00:19:26.000ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7432024-11-06T00:19:26.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7442024-11-06T00:19:26.002ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7452024-11-06T00:19:26.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7462024-11-06T00:19:26.004ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7472024-11-06T00:19:26.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7482024-11-06T00:19:26.005ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7492024-11-06T00:19:26.008ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7502024-11-06T00:19:26.008ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7512024-11-06T00:19:26.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7522024-11-06T00:19:26.016ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7532024-11-06T00:19:26.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7542024-11-06T00:19:26.020ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7552024-11-06T00:19:26.020ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 213.272252ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7562024-11-06T00:19:26.028ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
7572024-11-06T00:19:26.029ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7582024-11-06T00:19:26.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7592024-11-06T00:19:26.031ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7602024-11-06T00:19:26.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
7612024-11-06T00:19:26.032ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7622024-11-06T00:19:26.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7632024-11-06T00:19:26.043ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
7642024-11-06T00:19:26.043ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
7652024-11-06T00:19:26.043ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
7662024-11-06T00:19:26.062ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7672024-11-06T00:19:26.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7682024-11-06T00:19:26.064ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(858559a3-0152-42d6-8e7c-b30e57442bbc, 0)]
7692024-11-06T00:19:26.064ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1029, tv_nsec: 402833504 } })
7702024-11-06T00:19:26.065ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7712024-11-06T00:19:26.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7722024-11-06T00:19:26.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7732024-11-06T00:19:26.068ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7742024-11-06T00:19:26.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7752024-11-06T00:19:26.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7762024-11-06T00:19:26.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7772024-11-06T00:19:26.072ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7782024-11-06T00:19:26.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7792024-11-06T00:19:26.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7802024-11-06T00:19:26.098ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
7812024-11-06T00:19:26.098ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
7822024-11-06T00:19:26.098ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
7832024-11-06T00:19:26.099ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8c4fe60-36be-4e50-8228-a5bdc0dab025", "content-length": "476", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
7842024-11-06T00:19:26.101ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
7852024-11-06T00:19:26.101ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5773a162-2c77-4bf9-92d6-60c6b8cf28d9", "content-length": "734", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
7862024-11-06T00:19:26.102ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
7872024-11-06T00:19:26.103ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f00ed39f-9d8e-44f0-8e36-912c23446654", "content-length": "111", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
7882024-11-06T00:19:26.103ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
7892024-11-06T00:19:26.103ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "30df7676-1683-46cc-8bcb-ff4cf1c6a94b", "content-length": "111", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
7902024-11-06T00:19:26.103ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
7912024-11-06T00:19:26.103ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0709ff8e-fcf5-48f9-b536-1b97f54b3b1b", "content-length": "167", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
7922024-11-06T00:19:26.103ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
7932024-11-06T00:19:26.104ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c331f7e-0936-4221-9b78-170af3c7b544", "content-length": "167", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
7942024-11-06T00:19:26.104ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
7952024-11-06T00:19:26.104ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "faca08c8-e56c-48d5-a010-1b4eb5cecf72", "content-length": "175", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
7962024-11-06T00:19:26.104ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
7972024-11-06T00:19:26.104ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0daba10c-e8a3-4507-9f03-b390eefbd4d1", "content-length": "175", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
7982024-11-06T00:19:26.104ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
7992024-11-06T00:19:26.104ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb907a1b-c814-4fb1-90d7-e455d5f8eff2", "content-length": "702", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
8002024-11-06T00:19:26.104ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8012024-11-06T00:19:26.105ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bba91a3b-5079-45d3-933f-d4a2b3fb2939", "content-length": "727", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
8022024-11-06T00:19:26.105ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8032024-11-06T00:19:26.105ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e638cae4-cd9c-4b64-be26-a79621a39ab7", "content-length": "729", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
8042024-11-06T00:19:26.105ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8052024-11-06T00:19:26.106ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a13dbd5f-7cf4-45d3-acbe-93f67dbe57f4", "content-length": "728", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
8062024-11-06T00:19:26.106ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
8072024-11-06T00:19:26.106ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6f72164-05aa-4f4a-84e5-ab9b889297b9", "content-length": "722", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
8082024-11-06T00:19:26.106ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
8092024-11-06T00:19:26.106ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7946434-6b44-48cc-b26a-5478eea5a848", "content-length": "109", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
8102024-11-06T00:19:26.106ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
8112024-11-06T00:19:26.107ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "66e155f8-4b9d-435f-a46c-978b90559b19", "content-length": "109", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
8122024-11-06T00:19:26.107ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
8132024-11-06T00:19:26.107ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e3cf19d-1926-49df-9b6b-d63b67124e28", "content-length": "169", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
8142024-11-06T00:19:26.107ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
8152024-11-06T00:19:26.108ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7128714a-6405-463d-b829-7e36f02bc3b6", "content-length": "169", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
8162024-11-06T00:19:26.108ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
8172024-11-06T00:19:26.108ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a885f03-4944-47a3-bcaa-369506a23362", "content-length": "178", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
8182024-11-06T00:19:26.108ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
8192024-11-06T00:19:26.109ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d92e7357-7516-44f8-8e0c-3c480845e3e3", "content-length": "178", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
8202024-11-06T00:19:26.109ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
8212024-11-06T00:19:26.109ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7ef9e95-3efb-4cf0-b6a9-907933625456", "content-length": "702", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
8222024-11-06T00:19:26.109ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
8232024-11-06T00:19:26.109ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "be2227c1-5f18-4663-b66b-ca69a9054037", "content-length": "727", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
8242024-11-06T00:19:26.109ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
8252024-11-06T00:19:26.109ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d7ff6bc-1027-49aa-b9db-9416b6a8279d", "content-length": "729", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
8262024-11-06T00:19:26.109ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
8272024-11-06T00:19:26.109ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2db623a0-608d-4172-8c3d-1cc2e64b05cb", "content-length": "728", "date": "Wed, 06 Nov 2024 00:19:25 GMT"} })
8282024-11-06T00:19:26.109ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8292024-11-06T00:19:26.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8302024-11-06T00:19:26.139ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 331.579974ms iteration = 1 status = {}
8312024-11-06T00:19:26.147ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8322024-11-06T00:19:26.149ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
8332024-11-06T00:19:26.149ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8342024-11-06T00:19:26.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8352024-11-06T00:19:26.152ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8362024-11-06T00:19:26.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
8372024-11-06T00:19:26.153ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8382024-11-06T00:19:26.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8392024-11-06T00:19:26.211ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
8402024-11-06T00:19:26.212ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8412024-11-06T00:19:26.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8422024-11-06T00:19:26.214ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8432024-11-06T00:19:26.216ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
8442024-11-06T00:19:26.216ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8452024-11-06T00:19:26.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8462024-11-06T00:19:26.256ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8472024-11-06T00:19:26.256ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8482024-11-06T00:19:26.258ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8492024-11-06T00:19:26.258ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8502024-11-06T00:19:26.259ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8512024-11-06T00:19:26.260ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
8522024-11-06T00:19:26.260ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
8532024-11-06T00:19:26.260ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
8542024-11-06T00:19:26.261ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 453.054961ms
8552024-11-06T00:19:26.261ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 453.188625ms iteration = 1 status = {}
8562024-11-06T00:19:26.262ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 3a58cbfb-5015-41c2-9142-616f1a1558aa, lookup_type: ById(3a58cbfb-5015-41c2-9142-616f1a1558aa) } result = Ok(())
8572024-11-06T00:19:26.262ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, time_created: 2024-11-06T00:19:25.418943Z, time_modified: 2024-11-06T00:19:25.418943Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:765
8582024-11-06T00:19:26.327ZERROnexus (BackgroundTasks): nexus is running but no service zone nat values could be generated from inventory background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:257
8592024-11-06T00:19:26.327ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 519.767002ms iteration = 1 status = {"error":"nexus is running but no service zone nat values could be generated from inventory"}
8602024-11-06T00:19:26.347ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 2e32438c-b396-4de0-8fae-c5dba322a964 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
8612024-11-06T00:19:26.347ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 2e32438c-b396-4de0-8fae-c5dba322a964 time_started = 2024-11-06 00:19:26.098273 UTC
8622024-11-06T00:19:26.347ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 539.89256ms iteration = 1 status = {"collection_id":"2e32438c-b396-4de0-8fae-c5dba322a964","time_done":"2024-11-06 00:19:26.211056 UTC","time_started":"2024-11-06 00:19:26.098273 UTC"}
8632024-11-06T00:19:26.347ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
8642024-11-06T00:19:26.347ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8652024-11-06T00:19:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8662024-11-06T00:19:26.349ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8672024-11-06T00:19:26.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8682024-11-06T00:19:26.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8692024-11-06T00:19:26.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8702024-11-06T00:19:26.353ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
8712024-11-06T00:19:26.353ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.408191ms iteration = 2 status = {"error":"rack not yet initialized: 3a58cbfb-5015-41c2-9142-616f1a1558aa"}
8722024-11-06T00:19:27.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8732024-11-06T00:19:27.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8742024-11-06T00:19:27.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8752024-11-06T00:19:27.575ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8762024-11-06T00:19:27.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8772024-11-06T00:19:27.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8782024-11-06T00:19:27.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8792024-11-06T00:19:27.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8802024-11-06T00:19:27.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8812024-11-06T00:19:27.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8822024-11-06T00:19:27.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8832024-11-06T00:19:27.602ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Rack { parent: Fleet, key: 3a58cbfb-5015-41c2-9142-616f1a1558aa, lookup_type: ById(3a58cbfb-5015-41c2-9142-616f1a1558aa) } result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8842024-11-06T00:19:27.602ZDEBGnexus (dropshot_internal): updating rack subnet for rack 3a58cbfb-5015-41c2-9142-616f1a1558aa to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8852024-11-06T00:19:27.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8862024-11-06T00:19:27.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8872024-11-06T00:19:27.613ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8882024-11-06T00:19:27.645ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8892024-11-06T00:19:27.645ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "b044d379-3ee8-4fe0-9a2a-9bbb9e727d60", "content-length": "24", "date": "Wed, 06 Nov 2024 00:19:26 GMT"} }) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8902024-11-06T00:19:27.647ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8912024-11-06T00:19:27.647ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8922024-11-06T00:19:27.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8932024-11-06T00:19:27.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8942024-11-06T00:19:27.667ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8952024-11-06T00:19:27.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8962024-11-06T00:19:27.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8972024-11-06T00:19:27.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8982024-11-06T00:19:27.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
8992024-11-06T00:19:27.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9002024-11-06T00:19:27.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9012024-11-06T00:19:27.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9022024-11-06T00:19:27.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9032024-11-06T00:19:27.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9042024-11-06T00:19:27.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9052024-11-06T00:19:27.885ZERROnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound file = nexus/db-queries/src/db/datastore/switch_port.rs:890 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9062024-11-06T00:19:27.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9072024-11-06T00:19:27.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9082024-11-06T00:19:27.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9092024-11-06T00:19:27.894ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9102024-11-06T00:19:27.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9112024-11-06T00:19:27.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9122024-11-06T00:19:27.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9132024-11-06T00:19:27.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9142024-11-06T00:19:27.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9152024-11-06T00:19:27.905ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = IpPool { parent: Fleet, key: 06bcb77f-7c19-44cf-8d11-7cbeb40583d9, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9162024-11-06T00:19:27.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9172024-11-06T00:19:27.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9182024-11-06T00:19:27.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9192024-11-06T00:19:27.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9202024-11-06T00:19:27.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9212024-11-06T00:19:27.909ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = IpPool { parent: Fleet, key: 06bcb77f-7c19-44cf-8d11-7cbeb40583d9, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9222024-11-06T00:19:27.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9232024-11-06T00:19:27.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9242024-11-06T00:19:27.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9252024-11-06T00:19:27.931ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = BlueprintConfig result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9262024-11-06T00:19:28.049ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9272024-11-06T00:19:28.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9282024-11-06T00:19:28.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9292024-11-06T00:19:28.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9302024-11-06T00:19:28.053ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = BlueprintConfig result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9312024-11-06T00:19:28.066ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9322024-11-06T00:19:28.066ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9332024-11-06T00:19:28.066ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9342024-11-06T00:19:28.066ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9352024-11-06T00:19:28.066ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9362024-11-06T00:19:28.066ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9372024-11-06T00:19:28.066ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9382024-11-06T00:19:28.066ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9392024-11-06T00:19:28.159ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9402024-11-06T00:19:28.187ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9412024-11-06T00:19:28.207ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9422024-11-06T00:19:28.227ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9432024-11-06T00:19:28.253ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9442024-11-06T00:19:28.253ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9452024-11-06T00:19:28.253ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9462024-11-06T00:19:28.253ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9472024-11-06T00:19:28.253ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9482024-11-06T00:19:28.253ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9492024-11-06T00:19:28.253ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9502024-11-06T00:19:28.253ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9512024-11-06T00:19:28.253ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9522024-11-06T00:19:28.253ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9532024-11-06T00:19:28.253ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9542024-11-06T00:19:28.253ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9552024-11-06T00:19:28.253ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9562024-11-06T00:19:28.253ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9572024-11-06T00:19:28.253ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9582024-11-06T00:19:28.263ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9592024-11-06T00:19:28.264ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9602024-11-06T00:19:28.265ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9612024-11-06T00:19:28.266ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9622024-11-06T00:19:28.267ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9632024-11-06T00:19:28.270ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 3a58cbfb-5015-41c2-9142-616f1a1558aa, lookup_type: ById(3a58cbfb-5015-41c2-9142-616f1a1558aa) } result = Ok(())
9642024-11-06T00:19:28.270ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, time_created: 2024-11-06T00:19:25.418943Z, time_modified: 2024-11-06T00:19:25.418943Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
9652024-11-06T00:19:28.274ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9662024-11-06T00:19:28.274ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9672024-11-06T00:19:28.274ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: c8d72ed0-d8e8-4f66-b079-0c6e71be02de, time_created: 2024-11-06T00:19:27.575359055Z, time_modified: 2024-11-06T00:19:27.575359055Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 7c647f25-eb29-494d-840d-11658133af45, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9682024-11-06T00:19:28.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9692024-11-06T00:19:28.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9702024-11-06T00:19:28.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9712024-11-06T00:19:28.277ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9722024-11-06T00:19:28.311ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(7c647f25-eb29-494d-840d-11658133af45)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9732024-11-06T00:19:28.314ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "7c647f25-eb29-494d-840d-11658133af45" error_message_internal = not found: sled with id "7c647f25-eb29-494d-840d-11658133af45" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 742894 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 7ecca7eb-86c2-4478-9427-838f19f38122 response_code = 404 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9742024-11-06T00:19:30.271ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9752024-11-06T00:19:30.271ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9762024-11-06T00:19:30.273ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9772024-11-06T00:19:30.273ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9782024-11-06T00:19:30.275ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9792024-11-06T00:19:30.277ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 3a58cbfb-5015-41c2-9142-616f1a1558aa, lookup_type: ById(3a58cbfb-5015-41c2-9142-616f1a1558aa) } result = Ok(())
9802024-11-06T00:19:30.277ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, time_created: 2024-11-06T00:19:25.418943Z, time_modified: 2024-11-06T00:19:25.418943Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
9812024-11-06T00:19:32.278ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9822024-11-06T00:19:32.279ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9832024-11-06T00:19:32.280ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9842024-11-06T00:19:32.280ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9852024-11-06T00:19:32.282ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9862024-11-06T00:19:32.284ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 3a58cbfb-5015-41c2-9142-616f1a1558aa, lookup_type: ById(3a58cbfb-5015-41c2-9142-616f1a1558aa) } result = Ok(())
9872024-11-06T00:19:32.284ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, time_created: 2024-11-06T00:19:25.418943Z, time_modified: 2024-11-06T00:19:25.418943Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
9882024-11-06T00:19:32.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9892024-11-06T00:19:32.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9902024-11-06T00:19:32.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9912024-11-06T00:19:32.804ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9922024-11-06T00:19:32.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9932024-11-06T00:19:32.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9942024-11-06T00:19:32.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9952024-11-06T00:19:32.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9962024-11-06T00:19:32.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9972024-11-06T00:19:32.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9982024-11-06T00:19:32.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
9992024-11-06T00:19:32.812ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Rack { parent: Fleet, key: 3a58cbfb-5015-41c2-9142-616f1a1558aa, lookup_type: ById(3a58cbfb-5015-41c2-9142-616f1a1558aa) } result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10002024-11-06T00:19:32.812ZDEBGnexus (dropshot_internal): updating rack subnet for rack 3a58cbfb-5015-41c2-9142-616f1a1558aa to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10012024-11-06T00:19:32.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10022024-11-06T00:19:32.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10032024-11-06T00:19:32.820ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10042024-11-06T00:19:32.849ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10052024-11-06T00:19:32.850ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "540268cb-9fe0-44a1-b5da-2696cf178aa4", "content-length": "24", "date": "Wed, 06 Nov 2024 00:19:32 GMT"} }) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10062024-11-06T00:19:32.850ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10072024-11-06T00:19:32.850ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10082024-11-06T00:19:32.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10092024-11-06T00:19:32.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10102024-11-06T00:19:32.861ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10112024-11-06T00:19:32.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10122024-11-06T00:19:32.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10132024-11-06T00:19:32.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10142024-11-06T00:19:32.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10152024-11-06T00:19:32.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10162024-11-06T00:19:32.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10172024-11-06T00:19:32.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10182024-11-06T00:19:32.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10192024-11-06T00:19:32.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10202024-11-06T00:19:32.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10212024-11-06T00:19:32.873ZERROnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound file = nexus/db-queries/src/db/datastore/switch_port.rs:890 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10222024-11-06T00:19:32.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10232024-11-06T00:19:32.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10242024-11-06T00:19:32.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10252024-11-06T00:19:32.877ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10262024-11-06T00:19:32.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10272024-11-06T00:19:32.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10282024-11-06T00:19:32.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10292024-11-06T00:19:32.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10302024-11-06T00:19:32.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10312024-11-06T00:19:32.883ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = IpPool { parent: Fleet, key: 06bcb77f-7c19-44cf-8d11-7cbeb40583d9, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10322024-11-06T00:19:32.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10332024-11-06T00:19:32.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10342024-11-06T00:19:32.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10352024-11-06T00:19:32.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10362024-11-06T00:19:32.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10372024-11-06T00:19:32.887ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = IpPool { parent: Fleet, key: 06bcb77f-7c19-44cf-8d11-7cbeb40583d9, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10382024-11-06T00:19:32.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10392024-11-06T00:19:32.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10402024-11-06T00:19:32.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10412024-11-06T00:19:32.896ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = BlueprintConfig result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10422024-11-06T00:19:32.905ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10432024-11-06T00:19:32.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10442024-11-06T00:19:32.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10452024-11-06T00:19:32.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10462024-11-06T00:19:32.908ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = BlueprintConfig result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10472024-11-06T00:19:32.912ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10482024-11-06T00:19:32.912ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10492024-11-06T00:19:32.912ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10502024-11-06T00:19:32.912ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10512024-11-06T00:19:32.912ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10522024-11-06T00:19:32.912ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10532024-11-06T00:19:32.912ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10542024-11-06T00:19:32.912ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10552024-11-06T00:19:32.932ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10562024-11-06T00:19:32.956ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10572024-11-06T00:19:32.977ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10582024-11-06T00:19:32.998ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10592024-11-06T00:19:33.017ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10602024-11-06T00:19:33.017ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10612024-11-06T00:19:33.018ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10622024-11-06T00:19:33.018ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10632024-11-06T00:19:33.018ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10642024-11-06T00:19:33.018ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10652024-11-06T00:19:33.018ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10662024-11-06T00:19:33.018ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10672024-11-06T00:19:33.018ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10682024-11-06T00:19:33.018ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10692024-11-06T00:19:33.018ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10702024-11-06T00:19:33.018ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10712024-11-06T00:19:33.018ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10722024-11-06T00:19:33.018ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10732024-11-06T00:19:33.018ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10742024-11-06T00:19:33.038ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10752024-11-06T00:19:33.038ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10762024-11-06T00:19:33.038ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: c8d72ed0-d8e8-4f66-b079-0c6e71be02de, time_created: 2024-11-06T00:19:32.804367838Z, time_modified: 2024-11-06T00:19:32.804367838Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 7c647f25-eb29-494d-840d-11658133af45, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10772024-11-06T00:19:33.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10782024-11-06T00:19:33.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10792024-11-06T00:19:33.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10802024-11-06T00:19:33.042ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10812024-11-06T00:19:33.049ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: aad1632d-f381-4492-ae3e-ca57ba56ff94, time_created: 2024-11-06T00:19:32.804368378Z, time_modified: 2024-11-06T00:19:32.804368378Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2", variant: U2, sled_id: 7c647f25-eb29-494d-840d-11658133af45, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10822024-11-06T00:19:33.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10832024-11-06T00:19:33.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10842024-11-06T00:19:33.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10852024-11-06T00:19:33.053ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10862024-11-06T00:19:33.056ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: f87dcbd1-c137-44e3-baf2-3b70d9a0ebb8, time_created: 2024-11-06T00:19:32.804368468Z, time_modified: 2024-11-06T00:19:32.804368468Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2", variant: U2, sled_id: 7c647f25-eb29-494d-840d-11658133af45, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10872024-11-06T00:19:33.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10882024-11-06T00:19:33.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10892024-11-06T00:19:33.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10902024-11-06T00:19:33.060ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10912024-11-06T00:19:33.063ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 32048f19-6860-424a-8eff-4f18fc896448, time_created: 2024-11-06T00:19:32.804368588Z, time_modified: 2024-11-06T00:19:32.804368588Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2", variant: U2, sled_id: 7c647f25-eb29-494d-840d-11658133af45, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10922024-11-06T00:19:33.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10932024-11-06T00:19:33.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10942024-11-06T00:19:33.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10952024-11-06T00:19:33.067ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10962024-11-06T00:19:33.071ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 0ba9ff81-5279-4613-8430-fe63252470c5, time_created: 2024-11-06T00:19:32.804368658Z, time_modified: 2024-11-06T00:19:32.804368658Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2", variant: U2, sled_id: 7c647f25-eb29-494d-840d-11658133af45, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10972024-11-06T00:19:33.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10982024-11-06T00:19:33.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
10992024-11-06T00:19:33.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11002024-11-06T00:19:33.074ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11012024-11-06T00:19:33.078ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 1a8ba944-15ac-4cd9-b128-cf368a9c0ced, time_created: 2024-11-06T00:19:32.804368728Z, time_modified: 2024-11-06T00:19:32.804368728Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2", variant: U2, sled_id: 7c647f25-eb29-494d-840d-11658133af45, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11022024-11-06T00:19:33.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11032024-11-06T00:19:33.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11042024-11-06T00:19:33.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11052024-11-06T00:19:33.081ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11062024-11-06T00:19:33.086ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: f241f3e3-afef-480e-8a10-ca7c5f9b898b, time_created: 2024-11-06T00:19:32.804368798Z, time_modified: 2024-11-06T00:19:32.804368798Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2", variant: U2, sled_id: 7c647f25-eb29-494d-840d-11658133af45, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11072024-11-06T00:19:33.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11082024-11-06T00:19:33.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11092024-11-06T00:19:33.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11102024-11-06T00:19:33.089ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11112024-11-06T00:19:33.093ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: e29698d0-e020-4087-9475-9a122b08a7cf, time_created: 2024-11-06T00:19:32.804368868Z, time_modified: 2024-11-06T00:19:32.804368868Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2", variant: U2, sled_id: 7c647f25-eb29-494d-840d-11658133af45, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11122024-11-06T00:19:33.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11132024-11-06T00:19:33.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11142024-11-06T00:19:33.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11152024-11-06T00:19:33.095ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11162024-11-06T00:19:33.099ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: c55604b6-8a1c-4f82-97b2-aff60c0d9718, time_created: 2024-11-06T00:19:32.804368948Z, time_modified: 2024-11-06T00:19:32.804368948Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2", variant: U2, sled_id: 7c647f25-eb29-494d-840d-11658133af45, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11172024-11-06T00:19:33.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11182024-11-06T00:19:33.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11192024-11-06T00:19:33.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11202024-11-06T00:19:33.102ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11212024-11-06T00:19:33.107ZINFOnexus (dropshot_internal): Inserted physical disks actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:823 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11222024-11-06T00:19:33.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11232024-11-06T00:19:33.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11242024-11-06T00:19:33.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11252024-11-06T00:19:33.109ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11262024-11-06T00:19:33.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11272024-11-06T00:19:33.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11282024-11-06T00:19:33.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11292024-11-06T00:19:33.132ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11302024-11-06T00:19:33.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11312024-11-06T00:19:33.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11322024-11-06T00:19:33.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11332024-11-06T00:19:33.138ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11342024-11-06T00:19:33.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11352024-11-06T00:19:33.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11362024-11-06T00:19:33.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11372024-11-06T00:19:33.145ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11382024-11-06T00:19:33.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11392024-11-06T00:19:33.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11402024-11-06T00:19:33.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11412024-11-06T00:19:33.151ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11422024-11-06T00:19:33.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11432024-11-06T00:19:33.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11442024-11-06T00:19:33.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11452024-11-06T00:19:33.158ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11462024-11-06T00:19:33.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11472024-11-06T00:19:33.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11482024-11-06T00:19:33.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11492024-11-06T00:19:33.165ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11502024-11-06T00:19:33.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11512024-11-06T00:19:33.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11522024-11-06T00:19:33.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11532024-11-06T00:19:33.174ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11542024-11-06T00:19:33.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11552024-11-06T00:19:33.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11562024-11-06T00:19:33.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11572024-11-06T00:19:33.181ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11582024-11-06T00:19:33.185ZINFOnexus (dropshot_internal): Inserted zpools actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:835 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11592024-11-06T00:19:33.306ZINFOnexus (dropshot_internal): Inserted datasets actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:865 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11602024-11-06T00:19:33.335ZINFOnexus (dropshot_internal): Populated DNS tables for internal DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:876 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11612024-11-06T00:19:33.340ZINFOnexus (dropshot_internal): Populated DNS tables for external DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:885 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11622024-11-06T00:19:33.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11632024-11-06T00:19:33.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11642024-11-06T00:19:33.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11652024-11-06T00:19:33.343ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11662024-11-06T00:19:33.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11672024-11-06T00:19:33.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11682024-11-06T00:19:33.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11692024-11-06T00:19:33.347ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11702024-11-06T00:19:33.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11712024-11-06T00:19:33.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11722024-11-06T00:19:33.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11732024-11-06T00:19:33.380ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = DnsConfig result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11742024-11-06T00:19:33.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11752024-11-06T00:19:33.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11762024-11-06T00:19:33.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11772024-11-06T00:19:33.384ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = DnsConfig result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11782024-11-06T00:19:33.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11792024-11-06T00:19:33.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11802024-11-06T00:19:33.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11812024-11-06T00:19:33.390ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = DnsConfig result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11822024-11-06T00:19:33.402ZINFOnexus (dropshot_internal): Created recovery silo actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:451 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11832024-11-06T00:19:33.403ZINFOnexus (dropshot_internal): Created recovery user actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:467 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11842024-11-06T00:19:33.416ZINFOnexus (dropshot_internal): Created recovery user's password actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:481 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11852024-11-06T00:19:33.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11862024-11-06T00:19:33.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11872024-11-06T00:19:33.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11882024-11-06T00:19:33.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11892024-11-06T00:19:33.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11902024-11-06T00:19:33.421ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) } result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11912024-11-06T00:19:33.421ZDEBGnexus (dropshot_internal): Generated role assignment queries actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11922024-11-06T00:19:33.425ZINFOnexus (dropshot_internal): Granted Silo privileges actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:509 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11932024-11-06T00:19:33.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11942024-11-06T00:19:33.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11952024-11-06T00:19:33.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11962024-11-06T00:19:33.428ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11972024-11-06T00:19:33.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11982024-11-06T00:19:33.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
11992024-11-06T00:19:33.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12002024-11-06T00:19:33.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12012024-11-06T00:19:33.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12022024-11-06T00:19:33.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12032024-11-06T00:19:33.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12042024-11-06T00:19:33.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12052024-11-06T00:19:33.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12062024-11-06T00:19:33.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12072024-11-06T00:19:33.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12082024-11-06T00:19:33.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12092024-11-06T00:19:33.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12102024-11-06T00:19:33.461ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12112024-11-06T00:19:33.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12122024-11-06T00:19:33.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12132024-11-06T00:19:33.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12142024-11-06T00:19:33.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12152024-11-06T00:19:33.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12162024-11-06T00:19:33.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12172024-11-06T00:19:33.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12182024-11-06T00:19:33.469ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12192024-11-06T00:19:33.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12202024-11-06T00:19:33.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12212024-11-06T00:19:33.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12222024-11-06T00:19:33.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12232024-11-06T00:19:33.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12242024-11-06T00:19:33.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12252024-11-06T00:19:33.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12262024-11-06T00:19:33.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12272024-11-06T00:19:33.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12282024-11-06T00:19:33.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12292024-11-06T00:19:33.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12302024-11-06T00:19:33.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12312024-11-06T00:19:33.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12322024-11-06T00:19:33.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12332024-11-06T00:19:33.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12342024-11-06T00:19:33.483ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12352024-11-06T00:19:33.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12362024-11-06T00:19:33.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12372024-11-06T00:19:33.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12382024-11-06T00:19:33.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12392024-11-06T00:19:33.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12402024-11-06T00:19:33.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12412024-11-06T00:19:33.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12422024-11-06T00:19:33.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12432024-11-06T00:19:33.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12442024-11-06T00:19:33.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12452024-11-06T00:19:33.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12462024-11-06T00:19:33.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12472024-11-06T00:19:33.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12482024-11-06T00:19:33.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12492024-11-06T00:19:33.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12502024-11-06T00:19:33.497ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12512024-11-06T00:19:33.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12522024-11-06T00:19:33.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12532024-11-06T00:19:33.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12542024-11-06T00:19:33.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12552024-11-06T00:19:33.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12562024-11-06T00:19:33.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12572024-11-06T00:19:33.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12582024-11-06T00:19:33.504ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12592024-11-06T00:19:33.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12602024-11-06T00:19:33.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12612024-11-06T00:19:33.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12622024-11-06T00:19:33.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12632024-11-06T00:19:33.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12642024-11-06T00:19:33.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12652024-11-06T00:19:33.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12662024-11-06T00:19:33.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12672024-11-06T00:19:33.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12682024-11-06T00:19:33.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12692024-11-06T00:19:33.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12702024-11-06T00:19:33.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12712024-11-06T00:19:33.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12722024-11-06T00:19:33.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12732024-11-06T00:19:33.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12742024-11-06T00:19:33.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12752024-11-06T00:19:33.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12762024-11-06T00:19:33.521ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12772024-11-06T00:19:33.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12782024-11-06T00:19:33.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12792024-11-06T00:19:33.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12802024-11-06T00:19:33.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12812024-11-06T00:19:33.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12822024-11-06T00:19:33.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12832024-11-06T00:19:33.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12842024-11-06T00:19:33.527ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12852024-11-06T00:19:33.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12862024-11-06T00:19:33.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12872024-11-06T00:19:33.533ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 5bdcd428-292d-4d10-9115-282b4950a6c7, kind: Service { id: 309c9aef-da72-4f08-9f70-c20d80316472 }, name: Name("external-dns-309c9aef-da72-4f08-9f70-c20d80316472"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bddae3f-1834-4c3e-96a7-d7374171c136, kind: Service { id: 9bf7f7e3-0a6c-48b6-84be-c4bb8425f761 }, name: Name("external-dns-9bf7f7e3-0a6c-48b6-84be-c4bb8425f761"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 37bbd7b6-d736-4142-9ad8-60e594545f3d, kind: Service { id: f13e9b98-ae91-4d61-ba9b-3b178cfa151a }, name: Name("nexus-f13e9b98-ae91-4d61-ba9b-3b178cfa151a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acdf8cb7-85f2-4777-8bd4-f403275388d3, kind: Service { id: f633068a-05f8-4be2-a65b-d83ac560f7a9 }, name: Name("nexus-f633068a-05f8-4be2-a65b-d83ac560f7a9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6096ff9-4d2b-4b07-af5b-bb3cff616f69, kind: Service { id: e2378399-e8ed-453c-847a-0a419dfd0966 }, name: Name("nexus-e2378399-e8ed-453c-847a-0a419dfd0966"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
12882024-11-06T00:19:33.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12892024-11-06T00:19:33.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12902024-11-06T00:19:33.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12912024-11-06T00:19:33.536ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Fleet result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12922024-11-06T00:19:33.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e roles = RoleSet { roles: {} } uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12932024-11-06T00:19:33.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e resource = Database result = Ok(()) uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
12942024-11-06T00:19:33.537ZDEBGnexus: Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
12952024-11-06T00:19:33.542ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5bdcd428-292d-4d10-9115-282b4950a6c7, kind: Service { id: 309c9aef-da72-4f08-9f70-c20d80316472 }, name: Name("external-dns-309c9aef-da72-4f08-9f70-c20d80316472"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bddae3f-1834-4c3e-96a7-d7374171c136, kind: Service { id: 9bf7f7e3-0a6c-48b6-84be-c4bb8425f761 }, name: Name("external-dns-9bf7f7e3-0a6c-48b6-84be-c4bb8425f761"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 37bbd7b6-d736-4142-9ad8-60e594545f3d, kind: Service { id: f13e9b98-ae91-4d61-ba9b-3b178cfa151a }, name: Name("nexus-f13e9b98-ae91-4d61-ba9b-3b178cfa151a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acdf8cb7-85f2-4777-8bd4-f403275388d3, kind: Service { id: f633068a-05f8-4be2-a65b-d83ac560f7a9 }, name: Name("nexus-f633068a-05f8-4be2-a65b-d83ac560f7a9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6096ff9-4d2b-4b07-af5b-bb3cff616f69, kind: Service { id: e2378399-e8ed-453c-847a-0a419dfd0966 }, name: Name("nexus-e2378399-e8ed-453c-847a-0a419dfd0966"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
12962024-11-06T00:19:33.542ZDEBGnexus: resolved 2 rules for sleds
12972024-11-06T00:19:33.643ZDEBGnexus: resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 7c647f25-eb29-494d-840d-11658133af45, time_created: 2024-11-06T00:19:28.362863Z, time_modified: 2024-11-06T00:19:28.362863Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
12982024-11-06T00:19:33.643ZDEBGnexus: sending firewall rules to sled agents
12992024-11-06T00:19:33.644ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
13002024-11-06T00:19:33.644ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
13012024-11-06T00:19:33.647ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
13022024-11-06T00:19:33.647ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
13032024-11-06T00:19:33.648ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
13042024-11-06T00:19:33.650ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
13052024-11-06T00:19:33.681ZDEBGnexus: client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
13062024-11-06T00:19:33.682ZDEBGnexus: client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "6daa7edb-44ab-43dc-bfef-22f39c26a7f3", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
13072024-11-06T00:19:33.683ZINFOnexus: updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
13082024-11-06T00:19:33.683ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Signaled
13092024-11-06T00:19:33.683ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Signaled
13102024-11-06T00:19:33.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 882503 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64826 req_id = 03e30029-cbb5-436d-ad9e-aa32fbf6606e response_code = 204 uri = /racks/3a58cbfb-5015-41c2-9142-616f1a1558aa/initialization-complete
13112024-11-06T00:19:33.683ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Signaled
13122024-11-06T00:19:33.683ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
13132024-11-06T00:19:33.683ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13142024-11-06T00:19:33.683ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13152024-11-06T00:19:33.683ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Signaled
13162024-11-06T00:19:33.683ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13172024-11-06T00:19:33.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13182024-11-06T00:19:33.683ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Signaled
13192024-11-06T00:19:33.683ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13202024-11-06T00:19:33.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13212024-11-06T00:19:33.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13222024-11-06T00:19:33.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13232024-11-06T00:19:33.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13242024-11-06T00:19:33.683ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51df9631-cef5-49ae-8cfd-f0c05bdac388.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7102227a-61f8-4dda-a9a0-f6678fae71c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1037, tv_nsec: 21685930 } })
13252024-11-06T00:19:33.684ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("309c9aef-da72-4f08-9f70-c20d80316472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1037, tv_nsec: 21882856 } })
13262024-11-06T00:19:33.684ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13272024-11-06T00:19:33.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13282024-11-06T00:19:33.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13292024-11-06T00:19:33.684ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
13302024-11-06T00:19:33.684ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
13312024-11-06T00:19:33.684ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.114583ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
13322024-11-06T00:19:33.684ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.113663ms iteration = 2 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
13332024-11-06T00:19:33.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13342024-11-06T00:19:33.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13352024-11-06T00:19:33.685ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13362024-11-06T00:19:33.685ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13372024-11-06T00:19:33.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13382024-11-06T00:19:33.688ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13392024-11-06T00:19:33.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13402024-11-06T00:19:33.688ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
13412024-11-06T00:19:33.688ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13422024-11-06T00:19:33.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13432024-11-06T00:19:33.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13442024-11-06T00:19:33.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13452024-11-06T00:19:33.690ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(858559a3-0152-42d6-8e7c-b30e57442bbc, 0), (99ed39a3-d243-46e4-b8f2-b957807c45ae, 0), (2e32438c-b396-4de0-8fae-c5dba322a964, 0), (6798548e-560b-4da1-9692-f3b14b5b6fca, 0)] collection_id = 858559a3-0152-42d6-8e7c-b30e57442bbc
13462024-11-06T00:19:33.690ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13472024-11-06T00:19:33.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13482024-11-06T00:19:33.691ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13492024-11-06T00:19:33.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13502024-11-06T00:19:33.695ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13512024-11-06T00:19:33.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
13522024-11-06T00:19:33.698ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13532024-11-06T00:19:33.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13542024-11-06T00:19:33.719ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13552024-11-06T00:19:33.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13562024-11-06T00:19:33.724ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
13572024-11-06T00:19:33.724ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
13582024-11-06T00:19:33.724ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
13592024-11-06T00:19:33.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13602024-11-06T00:19:33.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13612024-11-06T00:19:33.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13622024-11-06T00:19:33.726ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
13632024-11-06T00:19:33.726ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
13642024-11-06T00:19:33.726ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
13652024-11-06T00:19:33.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13662024-11-06T00:19:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13672024-11-06T00:19:33.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13682024-11-06T00:19:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13692024-11-06T00:19:33.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13702024-11-06T00:19:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13712024-11-06T00:19:33.730ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
13722024-11-06T00:19:33.730ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
13732024-11-06T00:19:33.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13742024-11-06T00:19:33.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13752024-11-06T00:19:33.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13762024-11-06T00:19:33.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13772024-11-06T00:19:33.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13782024-11-06T00:19:33.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13792024-11-06T00:19:33.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13802024-11-06T00:19:33.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13812024-11-06T00:19:33.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13822024-11-06T00:19:33.740ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13832024-11-06T00:19:33.740ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
13842024-11-06T00:19:33.741ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
13852024-11-06T00:19:33.741ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13862024-11-06T00:19:33.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13872024-11-06T00:19:33.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13882024-11-06T00:19:33.742ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13892024-11-06T00:19:33.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13902024-11-06T00:19:33.744ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13912024-11-06T00:19:33.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13922024-11-06T00:19:33.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13932024-11-06T00:19:33.745ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
13942024-11-06T00:19:33.745ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
13952024-11-06T00:19:33.745ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
13962024-11-06T00:19:33.745ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 62.525677ms iteration = 2 status = {"generation":1}
13972024-11-06T00:19:33.745ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Dependency
13982024-11-06T00:19:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13992024-11-06T00:19:33.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14002024-11-06T00:19:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14012024-11-06T00:19:33.764ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
14022024-11-06T00:19:33.764ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
14032024-11-06T00:19:33.764ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
14042024-11-06T00:19:33.764ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 81.104618ms iteration = 2 status = {"generation":2}
14052024-11-06T00:19:33.764ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Dependency
14062024-11-06T00:19:33.788ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-06T00:19:22.736570Z, time_modified: 2024-11-06T00:19:22.736570Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
14072024-11-06T00:19:33.788ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 104.814172ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]}},"default_endpoint":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
14082024-11-06T00:19:33.813ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
14092024-11-06T00:19:33.834ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 858559a3-0152-42d6-8e7c-b30e57442bbc file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
14102024-11-06T00:19:33.834ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14112024-11-06T00:19:33.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14122024-11-06T00:19:33.837ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(99ed39a3-d243-46e4-b8f2-b957807c45ae, 0), (2e32438c-b396-4de0-8fae-c5dba322a964, 0), (6798548e-560b-4da1-9692-f3b14b5b6fca, 0)]
14132024-11-06T00:19:33.838ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1037, tv_nsec: 176269070 } })
14142024-11-06T00:19:33.908ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
14152024-11-06T00:19:33.937ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
14162024-11-06T00:19:33.937ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
14172024-11-06T00:19:33.937ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
14182024-11-06T00:19:33.937ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ce59d4b-fa53-4542-8002-783f0b5f5fb6", "content-length": "476", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14192024-11-06T00:19:33.937ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
14202024-11-06T00:19:33.937ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d096306-0e0c-4750-9a77-0e5e2ea56053", "content-length": "734", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14212024-11-06T00:19:33.937ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
14222024-11-06T00:19:33.938ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9213077-62a6-4e0c-86c8-0737566608e8", "content-length": "111", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14232024-11-06T00:19:33.938ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
14242024-11-06T00:19:33.938ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e4ffa1f-560e-4737-82ae-658e4b0d52e6", "content-length": "111", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14252024-11-06T00:19:33.938ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
14262024-11-06T00:19:33.938ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9d1214a-707c-4604-93a4-8082388fb4f8", "content-length": "167", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14272024-11-06T00:19:33.938ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
14282024-11-06T00:19:33.938ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3af3d66-a588-4181-9751-7fb0c1553a83", "content-length": "167", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14292024-11-06T00:19:33.938ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
14302024-11-06T00:19:33.939ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "92df7638-0d32-43c7-baf1-6dde702b2ad8", "content-length": "175", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14312024-11-06T00:19:33.939ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
14322024-11-06T00:19:33.939ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "74507f71-ba36-41c8-8285-1966076a5968", "content-length": "175", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14332024-11-06T00:19:33.939ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
14342024-11-06T00:19:33.939ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7faf44f2-1361-4d74-b05f-0700a5832b91", "content-length": "702", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14352024-11-06T00:19:33.939ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
14362024-11-06T00:19:33.939ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e51bc46a-e871-484a-a755-ef65de6eade0", "content-length": "727", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14372024-11-06T00:19:33.939ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
14382024-11-06T00:19:33.939ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a294ae4-991f-4573-b20d-3f2b02ee4e2f", "content-length": "729", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14392024-11-06T00:19:33.939ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
14402024-11-06T00:19:33.939ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bc16f97-98e4-4c12-b8dd-4d3d47f39c0f", "content-length": "728", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14412024-11-06T00:19:33.939ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
14422024-11-06T00:19:33.940ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "26571562-9784-4a1a-a6c2-bf764e827d13", "content-length": "722", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14432024-11-06T00:19:33.940ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
14442024-11-06T00:19:33.940ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "14464223-efce-4e00-89ce-eea701c24650", "content-length": "109", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14452024-11-06T00:19:33.940ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
14462024-11-06T00:19:33.940ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca680562-4ac8-494b-963a-2538a6490bb1", "content-length": "109", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14472024-11-06T00:19:33.940ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
14482024-11-06T00:19:33.940ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "eaf3ca32-e73a-4369-8372-50a8cd442f03", "content-length": "169", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14492024-11-06T00:19:33.940ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
14502024-11-06T00:19:33.941ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "234a8f6f-e43e-414c-b8b9-847c357d2c1e", "content-length": "169", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14512024-11-06T00:19:33.941ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
14522024-11-06T00:19:33.941ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "316a105a-d341-4bba-83e2-6a21e830ffee", "content-length": "178", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14532024-11-06T00:19:33.941ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
14542024-11-06T00:19:33.941ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "75c5906a-04df-4702-bf61-e62faa54de5a", "content-length": "178", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14552024-11-06T00:19:33.941ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
14562024-11-06T00:19:33.941ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3369de7d-8e4c-43b6-ad72-0404c10e57c4", "content-length": "702", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14572024-11-06T00:19:33.941ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
14582024-11-06T00:19:33.942ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "78633cf3-6390-4da4-a73d-2a27475232d9", "content-length": "727", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14592024-11-06T00:19:33.942ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
14602024-11-06T00:19:33.942ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f136a08-b5e3-420d-9db6-a81528744a5a", "content-length": "729", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14612024-11-06T00:19:33.942ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
14622024-11-06T00:19:33.942ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c14c93f-0a60-4447-ab44-7ba602a458c9", "content-length": "728", "date": "Wed, 06 Nov 2024 00:19:33 GMT"} })
14632024-11-06T00:19:33.942ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14642024-11-06T00:19:33.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14652024-11-06T00:19:33.944ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14662024-11-06T00:19:33.945ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
14672024-11-06T00:19:33.945ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14682024-11-06T00:19:33.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14692024-11-06T00:19:33.947ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14702024-11-06T00:19:33.949ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
14712024-11-06T00:19:33.949ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14722024-11-06T00:19:33.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14732024-11-06T00:19:33.982ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
14742024-11-06T00:19:34.051ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
14752024-11-06T00:19:34.051ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
14762024-11-06T00:19:34.080ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
14772024-11-06T00:19:34.094ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
14782024-11-06T00:19:34.107ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7c74b413-c280-41c5-a038-e2f71580b7b1", "date": "Wed, 06 Nov 2024 00:19:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
14792024-11-06T00:19:34.107ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
14802024-11-06T00:19:34.108ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b542d9c9-58a2-46a6-9ea9-222bfc8bb30b", "date": "Wed, 06 Nov 2024 00:19:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
14812024-11-06T00:19:34.108ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
14822024-11-06T00:19:34.109ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
14832024-11-06T00:19:34.109ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 345.066915ms iteration = 3 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
14842024-11-06T00:19:34.126ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "071c7980-123d-4e24-880d-98a90e3c06c5", "date": "Wed, 06 Nov 2024 00:19:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14852024-11-06T00:19:34.126ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14862024-11-06T00:19:34.130ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "dba17905-46d4-4b6b-a0c8-405a907c8550", "date": "Wed, 06 Nov 2024 00:19:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14872024-11-06T00:19:34.130ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14882024-11-06T00:19:34.133ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6d5d70b0-09a7-4f72-a58f-fd7a652050db", "date": "Wed, 06 Nov 2024 00:19:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14892024-11-06T00:19:34.133ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14902024-11-06T00:19:34.134ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14912024-11-06T00:19:34.134ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 388.962678ms iteration = 3 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
14922024-11-06T00:19:34.243ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "03f9db99-1449-4804-a738-3b3f759e9ecc", "content-length": "29180", "date": "Wed, 06 Nov 2024 00:19:34 GMT"} })
14932024-11-06T00:19:34.245ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
14942024-11-06T00:19:34.247ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14952024-11-06T00:19:34.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14962024-11-06T00:19:34.249ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14972024-11-06T00:19:34.250ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
14982024-11-06T00:19:34.250ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14992024-11-06T00:19:34.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15002024-11-06T00:19:34.286ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15012024-11-06T00:19:34.286ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15022024-11-06T00:19:34.287ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15032024-11-06T00:19:34.287ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15042024-11-06T00:19:34.289ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15052024-11-06T00:19:34.291ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 3a58cbfb-5015-41c2-9142-616f1a1558aa, lookup_type: ById(3a58cbfb-5015-41c2-9142-616f1a1558aa) } result = Ok(())
15062024-11-06T00:19:34.291ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:762
15072024-11-06T00:19:34.291ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15082024-11-06T00:19:34.291ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15092024-11-06T00:19:34.293ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15102024-11-06T00:19:34.293ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15112024-11-06T00:19:34.295ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15122024-11-06T00:19:34.295ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15132024-11-06T00:19:34.297ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15142024-11-06T00:19:34.297ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15152024-11-06T00:19:34.298ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15162024-11-06T00:19:34.298ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15172024-11-06T00:19:34.299ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15182024-11-06T00:19:34.299ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15192024-11-06T00:19:34.301ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15202024-11-06T00:19:34.304ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
15212024-11-06T00:19:34.304ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15222024-11-06T00:19:34.304ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15232024-11-06T00:19:34.305ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15242024-11-06T00:19:34.305ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15252024-11-06T00:19:34.307ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15262024-11-06T00:19:34.307ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15272024-11-06T00:19:34.308ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15282024-11-06T00:19:34.310ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
15292024-11-06T00:19:34.310ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15302024-11-06T00:19:34.311ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15312024-11-06T00:19:34.327ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15322024-11-06T00:19:34.328ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15332024-11-06T00:19:34.329ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15342024-11-06T00:19:34.329ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15352024-11-06T00:19:34.331ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15362024-11-06T00:19:34.331ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15372024-11-06T00:19:34.332ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15382024-11-06T00:19:34.332ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15392024-11-06T00:19:34.333ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15402024-11-06T00:19:34.333ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15412024-11-06T00:19:34.335ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15422024-11-06T00:19:34.335ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15432024-11-06T00:19:34.336ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15442024-11-06T00:19:34.339ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
15452024-11-06T00:19:34.339ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15462024-11-06T00:19:34.339ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15472024-11-06T00:19:34.340ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15482024-11-06T00:19:34.340ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15492024-11-06T00:19:34.342ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15502024-11-06T00:19:34.342ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15512024-11-06T00:19:34.344ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15522024-11-06T00:19:34.344ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15532024-11-06T00:19:34.346ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15542024-11-06T00:19:34.346ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15552024-11-06T00:19:34.347ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15562024-11-06T00:19:34.347ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15572024-11-06T00:19:34.349ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15582024-11-06T00:19:34.349ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15592024-11-06T00:19:34.350ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15602024-11-06T00:19:34.353ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
15612024-11-06T00:19:34.353ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15622024-11-06T00:19:34.353ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15632024-11-06T00:19:34.354ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15642024-11-06T00:19:34.354ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15652024-11-06T00:19:34.356ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15662024-11-06T00:19:34.356ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15672024-11-06T00:19:34.357ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15682024-11-06T00:19:34.360ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
15692024-11-06T00:19:34.360ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15702024-11-06T00:19:34.361ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15712024-11-06T00:19:34.366ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15722024-11-06T00:19:34.367ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15732024-11-06T00:19:34.368ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15742024-11-06T00:19:34.368ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15752024-11-06T00:19:34.369ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15762024-11-06T00:19:34.370ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15772024-11-06T00:19:34.372ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15782024-11-06T00:19:34.372ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15792024-11-06T00:19:34.374ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15802024-11-06T00:19:34.374ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15812024-11-06T00:19:34.375ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15822024-11-06T00:19:34.375ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15832024-11-06T00:19:34.376ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15842024-11-06T00:19:34.376ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15852024-11-06T00:19:34.377ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15862024-11-06T00:19:34.381ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
15872024-11-06T00:19:34.381ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15882024-11-06T00:19:34.381ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15892024-11-06T00:19:34.382ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15902024-11-06T00:19:34.382ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15912024-11-06T00:19:34.384ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15922024-11-06T00:19:34.384ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15932024-11-06T00:19:34.385ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15942024-11-06T00:19:34.388ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
15952024-11-06T00:19:34.388ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15962024-11-06T00:19:34.388ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15972024-11-06T00:19:34.393ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 5bdcd428-292d-4d10-9115-282b4950a6c7, kind: Service { id: 309c9aef-da72-4f08-9f70-c20d80316472 }, name: Name("external-dns-309c9aef-da72-4f08-9f70-c20d80316472"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bddae3f-1834-4c3e-96a7-d7374171c136, kind: Service { id: 9bf7f7e3-0a6c-48b6-84be-c4bb8425f761 }, name: Name("external-dns-9bf7f7e3-0a6c-48b6-84be-c4bb8425f761"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 37bbd7b6-d736-4142-9ad8-60e594545f3d, kind: Service { id: f13e9b98-ae91-4d61-ba9b-3b178cfa151a }, name: Name("nexus-f13e9b98-ae91-4d61-ba9b-3b178cfa151a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acdf8cb7-85f2-4777-8bd4-f403275388d3, kind: Service { id: f633068a-05f8-4be2-a65b-d83ac560f7a9 }, name: Name("nexus-f633068a-05f8-4be2-a65b-d83ac560f7a9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6096ff9-4d2b-4b07-af5b-bb3cff616f69, kind: Service { id: e2378399-e8ed-453c-847a-0a419dfd0966 }, name: Name("nexus-e2378399-e8ed-453c-847a-0a419dfd0966"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
15982024-11-06T00:19:34.393ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15992024-11-06T00:19:34.393ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16002024-11-06T00:19:34.395ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16012024-11-06T00:19:34.395ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = f16050de-5f20-4a74-8f6a-54e5add5803d file = nexus/db-queries/src/db/datastore/inventory.rs:1000
16022024-11-06T00:19:34.395ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = f16050de-5f20-4a74-8f6a-54e5add5803d time_started = 2024-11-06 00:19:33.937089 UTC
16032024-11-06T00:19:34.395ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 712.169103ms iteration = 2 status = {"collection_id":"f16050de-5f20-4a74-8f6a-54e5add5803d","time_done":"2024-11-06 00:19:34.245373 UTC","time_started":"2024-11-06 00:19:33.937089 UTC"}
16042024-11-06T00:19:34.395ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
16052024-11-06T00:19:34.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16062024-11-06T00:19:34.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16072024-11-06T00:19:34.396ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
16082024-11-06T00:19:34.396ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16092024-11-06T00:19:34.396ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16102024-11-06T00:19:34.397ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16112024-11-06T00:19:34.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16122024-11-06T00:19:34.399ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16132024-11-06T00:19:34.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16142024-11-06T00:19:34.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16152024-11-06T00:19:34.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16162024-11-06T00:19:34.402ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16172024-11-06T00:19:34.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16182024-11-06T00:19:34.404ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16192024-11-06T00:19:34.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16202024-11-06T00:19:34.408ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
16212024-11-06T00:19:34.408ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5bdcd428-292d-4d10-9115-282b4950a6c7, kind: Service { id: 309c9aef-da72-4f08-9f70-c20d80316472 }, name: Name("external-dns-309c9aef-da72-4f08-9f70-c20d80316472"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bddae3f-1834-4c3e-96a7-d7374171c136, kind: Service { id: 9bf7f7e3-0a6c-48b6-84be-c4bb8425f761 }, name: Name("external-dns-9bf7f7e3-0a6c-48b6-84be-c4bb8425f761"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 37bbd7b6-d736-4142-9ad8-60e594545f3d, kind: Service { id: f13e9b98-ae91-4d61-ba9b-3b178cfa151a }, name: Name("nexus-f13e9b98-ae91-4d61-ba9b-3b178cfa151a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acdf8cb7-85f2-4777-8bd4-f403275388d3, kind: Service { id: f633068a-05f8-4be2-a65b-d83ac560f7a9 }, name: Name("nexus-f633068a-05f8-4be2-a65b-d83ac560f7a9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6096ff9-4d2b-4b07-af5b-bb3cff616f69, kind: Service { id: e2378399-e8ed-453c-847a-0a419dfd0966 }, name: Name("nexus-e2378399-e8ed-453c-847a-0a419dfd0966"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
16222024-11-06T00:19:34.408ZDEBGnexus (InternalApi): resolved 2 rules for sleds
16232024-11-06T00:19:34.452ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 56.554539ms iteration = 3 status = {"physical_disks_added":0}
16242024-11-06T00:19:34.457ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 7c647f25-eb29-494d-840d-11658133af45, time_created: 2024-11-06T00:19:28.362863Z, time_modified: 2024-11-06T00:19:28.362863Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
16252024-11-06T00:19:34.457ZDEBGnexus (InternalApi): sending firewall rules to sled agents
16262024-11-06T00:19:34.457ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16272024-11-06T00:19:34.457ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16282024-11-06T00:19:34.459ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16292024-11-06T00:19:34.460ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16302024-11-06T00:19:34.461ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16312024-11-06T00:19:34.463ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
16322024-11-06T00:19:34.493ZDEBGnexus (InternalApi): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16332024-11-06T00:19:34.494ZDEBGnexus (InternalApi): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "04a9e68e-980c-4189-8239-483fda0e8bac", "date": "Wed, 06 Nov 2024 00:19:34 GMT"} })
16342024-11-06T00:19:34.495ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
16352024-11-06T00:19:34.495ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
16362024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /
16372024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /access
16382024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /assets/{path}
16392024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/auth
16402024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/confirm
16412024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/success
16422024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/token
16432024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/verify
16442024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes
16452024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /experimental/v1/probes
16462024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /experimental/v1/probes/{probe}
16472024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes/{probe}
16482024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /images
16492024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login
16502024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/local
16512024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}
16522024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /login/{silo_name}/saml/{provider_name}
16532024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
16542024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /lookup/{path}
16552024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects/{path}
16562024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects-new
16572024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /settings/{path}
16582024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /system/{path}
16592024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /utilization
16602024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates
16612024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/certificates
16622024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/certificates/{certificate}
16632024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates/{certificate}
16642024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks
16652024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks
16662024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/disks/{disk}
16672024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}
16682024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write
16692024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-start
16702024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-stop
16712024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/finalize
16722024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}/metrics/{metric}
16732024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips
16742024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips
16752024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/floating-ips/{floating_ip}
16762024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips/{floating_ip}
16772024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/floating-ips/{floating_ip}
16782024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/attach
16792024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/detach
16802024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups
16812024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups/{group_id}
16822024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images
16832024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images
16842024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/images/{image}
16852024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images/{image}
16862024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/demote
16872024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/promote
16882024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances
16892024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances
16902024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}
16912024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}
16922024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/instances/{instance}
16932024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/disks
16942024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/attach
16952024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/detach
16962024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/external-ips
16972024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
16982024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
16992024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/reboot
17002024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console
17012024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console/stream
17022024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/ssh-public-keys
17032024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/start
17042024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/stop
17052024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-addresses
17062024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-addresses
17072024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address}
17082024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-pools
17092024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-pools
17102024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool}
17112024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways
17122024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateways
17132024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateways/{gateway}
17142024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways/{gateway}
17152024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools
17162024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools/{pool}
17172024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/login/{silo_name}/local
17182024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/logout
17192024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me
17202024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/groups
17212024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys
17222024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/me/ssh-keys
17232024-11-06T00:19:34.507ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
17242024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys/{ssh_key}
17252024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/metrics/{metric_name}
17262024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces
17272024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/network-interfaces
17282024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/network-interfaces/{interface}
17292024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces/{interface}
17302024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/network-interfaces/{interface}
17312024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ping
17322024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/policy
17332024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/policy
17342024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects
17352024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/projects
17362024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/projects/{project}
17372024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}
17382024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}
17392024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}/policy
17402024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}/policy
17412024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots
17422024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/snapshots
17432024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/snapshots/{snapshot}
17442024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots/{snapshot}
17452024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks
17462024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks/{disk_id}
17472024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks
17482024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks/{rack_id}
17492024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds
17502024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/sleds
17512024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}
17522024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
17532024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
17542024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
17552024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds-uninitialized
17562024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port
17572024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
17582024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings
17592024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port/{port}/status
17602024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches
17612024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches/{switch_id}
17622024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers
17632024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users
17642024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
17652024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
17662024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/saml
17672024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers/saml/{provider}
17682024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools
17692024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools
17702024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}
17712024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}
17722024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}
17732024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/ranges
17742024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
17752024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
17762024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/silos
17772024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/silos
17782024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
17792024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
17802024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/utilization
17812024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service
17822024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service/ranges
17832024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/add
17842024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/remove
17852024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/metrics/{metric_name}
17862024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot
17872024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/address-lot
17882024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
17892024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
17902024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/allow-list
17912024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/allow-list
17922024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-disable
17932024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-enable
17942024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bfd-status
17952024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp
17962024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp
17972024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bgp
17982024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set
17992024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/bgp-announce-set
18002024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set}
18012024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement
18022024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-exported
18032024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-message-history
18042024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-routes-ipv4
18052024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-status
18062024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/loopback-address
18072024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/loopback-address
18082024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
18092024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/switch-port-settings
18102024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings
18112024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/switch-port-settings
18122024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings/{port}
18132024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/policy
18142024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/policy
18152024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles
18162024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles/{role_name}
18172024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silo-quotas
18182024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos
18192024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/silos
18202024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/silos/{silo}
18212024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}
18222024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/ip-pools
18232024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/policy
18242024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/policy
18252024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/quotas
18262024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/quotas
18272024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/update/repository
18282024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/update/repository/{system_version}
18292024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users
18302024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users/{user_id}
18312024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin
18322024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin/{user}
18332024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos
18342024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos/{silo}
18352024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/timeseries/query
18362024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/timeseries/schema
18372024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/users
18382024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/utilization
18392024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-firewall-rules
18402024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-firewall-rules
18412024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes
18422024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-router-routes
18432024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-router-routes/{route}
18442024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes/{route}
18452024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-router-routes/{route}
18462024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers
18472024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-routers
18482024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-routers/{router}
18492024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers/{router}
18502024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-routers/{router}
18512024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets
18522024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-subnets
18532024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-subnets/{subnet}
18542024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}
18552024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-subnets/{subnet}
18562024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
18572024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs
18582024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpcs
18592024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpcs/{vpc}
18602024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs/{vpc}
18612024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpcs/{vpc}
18622024-11-06T00:19:34.508ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = 172.30.2.6:443
18632024-11-06T00:19:34.508ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.6:443
18642024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /
18652024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /access
18662024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /assets/{path}
18672024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/auth
18682024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/confirm
18692024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/success
18702024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/token
18712024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/verify
18722024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes
18732024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /experimental/v1/probes
18742024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /experimental/v1/probes/{probe}
18752024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes/{probe}
18762024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /images
18772024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login
18782024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/local
18792024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}
18802024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /login/{silo_name}/saml/{provider_name}
18812024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
18822024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /lookup/{path}
18832024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects/{path}
18842024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects-new
18852024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /settings/{path}
18862024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /system/{path}
18872024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /utilization
18882024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates
18892024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/certificates
18902024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/certificates/{certificate}
18912024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates/{certificate}
18922024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks
18932024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks
18942024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/disks/{disk}
18952024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}
18962024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write
18972024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start
18982024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop
18992024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/finalize
19002024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric}
19012024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips
19022024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips
19032024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/floating-ips/{floating_ip}
19042024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips/{floating_ip}
19052024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/floating-ips/{floating_ip}
19062024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach
19072024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach
19082024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups
19092024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups/{group_id}
19102024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images
19112024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images
19122024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/images/{image}
19132024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images/{image}
19142024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/demote
19152024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/promote
19162024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances
19172024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances
19182024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}
19192024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}
19202024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/instances/{instance}
19212024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/disks
19222024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/attach
19232024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/detach
19242024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/external-ips
19252024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
19262024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
19272024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/reboot
19282024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console
19292024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream
19302024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys
19312024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/start
19322024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/stop
19332024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-addresses
19342024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-addresses
19352024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address}
19362024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-pools
19372024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-pools
19382024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool}
19392024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways
19402024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateways
19412024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateways/{gateway}
19422024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways/{gateway}
19432024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools
19442024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools/{pool}
19452024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/login/{silo_name}/local
19462024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/logout
19472024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me
19482024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/groups
19492024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys
19502024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/me/ssh-keys
19512024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
19522024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key}
19532024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/metrics/{metric_name}
19542024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces
19552024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/network-interfaces
19562024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/network-interfaces/{interface}
19572024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces/{interface}
19582024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/network-interfaces/{interface}
19592024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ping
19602024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/policy
19612024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/policy
19622024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects
19632024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/projects
19642024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/projects/{project}
19652024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}
19662024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}
19672024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}/policy
19682024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}/policy
19692024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots
19702024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/snapshots
19712024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/snapshots/{snapshot}
19722024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots/{snapshot}
19732024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks
19742024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks/{disk_id}
19752024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks
19762024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks/{rack_id}
19772024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds
19782024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/sleds
19792024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}
19802024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
19812024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
19822024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
19832024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized
19842024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port
19852024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
19862024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings
19872024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status
19882024-11-06T00:19:34.513ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches
19892024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches/{switch_id}
19902024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers
19912024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users
19922024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
19932024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
19942024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/saml
19952024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers/saml/{provider}
19962024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools
19972024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools
19982024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}
19992024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}
20002024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}
20012024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges
20022024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
20032024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
20042024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos
20052024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos
20062024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
20072024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
20082024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization
20092024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service
20102024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service/ranges
20112024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add
20122024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove
20132024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/metrics/{metric_name}
20142024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot
20152024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/address-lot
20162024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
20172024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
20182024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/allow-list
20192024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/allow-list
20202024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-disable
20212024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-enable
20222024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bfd-status
20232024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp
20242024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp
20252024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bgp
20262024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set
20272024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/bgp-announce-set
20282024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set}
20292024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement
20302024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-exported
20312024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-message-history
20322024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4
20332024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-status
20342024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/loopback-address
20352024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/loopback-address
20362024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
20372024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/switch-port-settings
20382024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings
20392024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/switch-port-settings
20402024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port}
20412024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/policy
20422024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/policy
20432024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles
20442024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles/{role_name}
20452024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silo-quotas
20462024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos
20472024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/silos
20482024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/silos/{silo}
20492024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}
20502024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools
20512024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/policy
20522024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/policy
20532024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/quotas
20542024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/quotas
20552024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/update/repository
20562024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/update/repository/{system_version}
20572024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users
20582024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users/{user_id}
20592024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin
20602024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin/{user}
20612024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos
20622024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos/{silo}
20632024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/timeseries/query
20642024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/timeseries/schema
20652024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/users
20662024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/utilization
20672024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-firewall-rules
20682024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-firewall-rules
20692024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes
20702024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-router-routes
20712024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-router-routes/{route}
20722024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes/{route}
20732024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-router-routes/{route}
20742024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers
20752024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-routers
20762024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-routers/{router}
20772024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers/{router}
20782024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-routers/{router}
20792024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets
20802024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-subnets
20812024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-subnets/{subnet}
20822024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}
20832024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-subnets/{subnet}
20842024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
20852024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs
20862024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpcs
20872024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpcs/{vpc}
20882024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs/{vpc}
20892024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpcs/{vpc}
20902024-11-06T00:19:34.514ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::b]:12228
20912024-11-06T00:19:34.514ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12228
20922024-11-06T00:19:34.514ZDEBGnexus (nexus-producer-server): registered DTrace probes
20932024-11-06T00:19:34.516ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::b]:35909 method = GET path = /{producer_id}
20942024-11-06T00:19:34.517ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::b]:35909
20952024-11-06T00:19:34.517ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:35909
20962024-11-06T00:19:34.517ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::b]:35909
20972024-11-06T00:19:34.517ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::b]:12221
20982024-11-06T00:19:34.517ZDEBGnexus (nexus-producer-server): starting producer registration task
20992024-11-06T00:19:34.518ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::b]:35909 file = oximeter/producer/src/lib.rs:283 interval = 10s producer_id = e2378399-e8ed-453c-847a-0a419dfd0966
21002024-11-06T00:19:34.518ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
21012024-11-06T00:19:34.518ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
21022024-11-06T00:19:34.549ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
21032024-11-06T00:19:34.549ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:44729
21042024-11-06T00:19:34.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44729 req_id = 1039d977-2103-4a76-8ca9-56b5d30cdd76 roles = RoleSet { roles: {} } uri = /metrics/producers
21052024-11-06T00:19:34.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44729 req_id = 1039d977-2103-4a76-8ca9-56b5d30cdd76 resource = Database result = Ok(()) uri = /metrics/producers
21062024-11-06T00:19:34.594ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = e2378399-e8ed-453c-847a-0a419dfd0966
21072024-11-06T00:19:34.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44616 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44729 req_id = 1039d977-2103-4a76-8ca9-56b5d30cdd76 response_code = 201 uri = /metrics/producers
21082024-11-06T00:19:34.594ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "1039d977-2103-4a76-8ca9-56b5d30cdd76", "content-length": "41", "date": "Wed, 06 Nov 2024 00:19:34 GMT"} })
21092024-11-06T00:19:34.596ZDEBGnexus (producer-registration-task): registered with nexus successfully
21102024-11-06T00:19:34.596ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
21112024-11-06T00:19:35.807ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
21122024-11-06T00:19:35.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21132024-11-06T00:19:35.807ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
21142024-11-06T00:19:35.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21152024-11-06T00:19:35.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21162024-11-06T00:19:35.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21172024-11-06T00:19:35.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21182024-11-06T00:19:35.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21192024-11-06T00:19:35.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21202024-11-06T00:19:35.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21212024-11-06T00:19:35.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21222024-11-06T00:19:35.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21232024-11-06T00:19:35.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21242024-11-06T00:19:35.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
21252024-11-06T00:19:35.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21262024-11-06T00:19:35.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21272024-11-06T00:19:35.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21282024-11-06T00:19:35.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21292024-11-06T00:19:35.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.562463ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21302024-11-06T00:19:35.911ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
21312024-11-06T00:19:35.911ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 103.245025ms iteration = 2 status = {"enabled":false,"status":"first target blueprint","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z","time_found":"2024-11-06T00:19:35.911004670Z"}
21322024-11-06T00:19:35.911ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
21332024-11-06T00:19:35.911ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
21342024-11-06T00:19:35.911ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846
21352024-11-06T00:19:35.911ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.87\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846"}
21362024-11-06T00:19:35.911ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21372024-11-06T00:19:35.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21382024-11-06T00:19:35.911ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21392024-11-06T00:19:35.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21402024-11-06T00:19:35.911ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21412024-11-06T00:19:35.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21422024-11-06T00:19:35.911ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21432024-11-06T00:19:35.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21442024-11-06T00:19:35.911ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21452024-11-06T00:19:35.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21462024-11-06T00:19:35.913ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21472024-11-06T00:19:35.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
21482024-11-06T00:19:35.915ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21492024-11-06T00:19:35.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21502024-11-06T00:19:35.915ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21512024-11-06T00:19:35.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
21522024-11-06T00:19:35.917ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21532024-11-06T00:19:35.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21542024-11-06T00:19:35.917ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21552024-11-06T00:19:35.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
21562024-11-06T00:19:35.919ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21572024-11-06T00:19:35.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21582024-11-06T00:19:35.919ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21592024-11-06T00:19:35.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
21602024-11-06T00:19:35.921ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21612024-11-06T00:19:35.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21622024-11-06T00:19:35.921ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21632024-11-06T00:19:35.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
21642024-11-06T00:19:35.922ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21652024-11-06T00:19:35.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21662024-11-06T00:19:35.924ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 13.391958ms iteration = 2 status = {"nsuccess":5}
21672024-11-06T00:19:36.543ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:35909 remote_addr = [fd00:1122:3344:101::d]:40170
21682024-11-06T00:19:36.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1125 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 0d066ecc-4cbc-4b58-a1a4-90b8a94323d3 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
21692024-11-06T00:19:36.739ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" } server_name = recovery.sys.oxide.test silo_id = 538efd2f-b8ed-4a95-91b1-680b63627575
21702024-11-06T00:19:36.749ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = 172.30.2.6:443 remote_addr = 10.151.2.100:61916
21712024-11-06T00:19:36.754ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21722024-11-06T00:19:36.754ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21732024-11-06T00:19:36.758ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21742024-11-06T00:19:36.758ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21752024-11-06T00:19:36.759ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21762024-11-06T00:19:36.760ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21772024-11-06T00:19:36.762ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21782024-11-06T00:19:36.763ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ByName("recovery") } result = Ok(())
21792024-11-06T00:19:36.763ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21802024-11-06T00:19:36.764ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21812024-11-06T00:19:36.765ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21822024-11-06T00:19:36.765ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21832024-11-06T00:19:36.767ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21842024-11-06T00:19:36.769ZDEBGnexus (ExternalAuthn): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ByName("recovery") } result = Ok(())
21852024-11-06T00:19:36.769ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21862024-11-06T00:19:36.769ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21872024-11-06T00:19:36.779ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21882024-11-06T00:19:36.779ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21892024-11-06T00:19:36.781ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21902024-11-06T00:19:36.781ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21912024-11-06T00:19:36.782ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21922024-11-06T00:19:36.783ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ByName("recovery") }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ByName("recovery") } result = Ok(())
21932024-11-06T00:19:36.783ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21942024-11-06T00:19:36.784ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21952024-11-06T00:19:37.494ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21962024-11-06T00:19:37.494ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21972024-11-06T00:19:37.504ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21982024-11-06T00:19:37.505ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21992024-11-06T00:19:37.510ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22002024-11-06T00:19:37.510ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22012024-11-06T00:19:37.512ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22022024-11-06T00:19:37.512ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22032024-11-06T00:19:37.514ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22042024-11-06T00:19:37.516ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
22052024-11-06T00:19:37.518ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22062024-11-06T00:19:37.518ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22072024-11-06T00:19:37.519ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22082024-11-06T00:19:37.521ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSessionList result = Ok(())
22092024-11-06T00:19:37.521ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22102024-11-06T00:19:37.521ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22112024-11-06T00:19:37.533ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 782356 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:61916 req_id = eda99929-2815-4cb0-8d27-e12389f3d894 response_code = 204 uri = /v1/login/recovery/local
22122024-11-06T00:19:37.570ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" } server_name = recovery.sys.oxide.test silo_id = 538efd2f-b8ed-4a95-91b1-680b63627575
22132024-11-06T00:19:37.575ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = 172.30.2.6:443 remote_addr = 10.151.2.100:49136
22142024-11-06T00:19:37.579ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22152024-11-06T00:19:37.579ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22162024-11-06T00:19:37.588ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22172024-11-06T00:19:37.589ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22182024-11-06T00:19:37.591ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22192024-11-06T00:19:37.592ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("token = \\"d27d5e9e4db716d98ec7ec234e0646949e77ad52\\"") } result = Ok(())
22202024-11-06T00:19:37.592ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22212024-11-06T00:19:37.592ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22222024-11-06T00:19:37.594ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22232024-11-06T00:19:37.594ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22242024-11-06T00:19:37.595ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22252024-11-06T00:19:37.595ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22262024-11-06T00:19:37.597ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22272024-11-06T00:19:37.597ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22282024-11-06T00:19:37.598ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22292024-11-06T00:19:37.599ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
22302024-11-06T00:19:37.599ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22312024-11-06T00:19:37.600ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22322024-11-06T00:19:37.601ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22332024-11-06T00:19:37.602ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("d27d5e9e4db716d98ec7ec234e0646949e77ad52") } result = Ok(())
22342024-11-06T00:19:37.603ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22352024-11-06T00:19:37.603ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22362024-11-06T00:19:37.613ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22372024-11-06T00:19:37.613ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22382024-11-06T00:19:37.621ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22392024-11-06T00:19:37.621ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22402024-11-06T00:19:37.622ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22412024-11-06T00:19:37.623ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22422024-11-06T00:19:37.624ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22432024-11-06T00:19:37.624ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22442024-11-06T00:19:37.625ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22452024-11-06T00:19:37.627ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
22462024-11-06T00:19:37.627ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22472024-11-06T00:19:37.627ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22482024-11-06T00:19:37.628ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22492024-11-06T00:19:37.629ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22502024-11-06T00:19:37.630ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22512024-11-06T00:19:37.630ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22522024-11-06T00:19:37.631ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22532024-11-06T00:19:37.633ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) } result = Ok(())
22542024-11-06T00:19:37.633ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:49136 req_id = be45feaf-8603-42f6-94bf-5c0d0d382baa roles = RoleSet { roles: {} } uri = /v1/projects
22552024-11-06T00:19:37.633ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:49136 req_id = be45feaf-8603-42f6-94bf-5c0d0d382baa resource = Database result = Ok(()) uri = /v1/projects
22562024-11-06T00:19:37.639ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:49136 req_id = be45feaf-8603-42f6-94bf-5c0d0d382baa roles = RoleSet { roles: {} } uri = /v1/projects
22572024-11-06T00:19:37.639ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:49136 req_id = be45feaf-8603-42f6-94bf-5c0d0d382baa resource = Database result = Ok(()) uri = /v1/projects
22582024-11-06T00:19:37.650ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:49136 req_id = be45feaf-8603-42f6-94bf-5c0d0d382baa roles = RoleSet { roles: {} } uri = /v1/projects
22592024-11-06T00:19:37.650ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:49136 req_id = be45feaf-8603-42f6-94bf-5c0d0d382baa resource = Database result = Ok(()) uri = /v1/projects
22602024-11-06T00:19:37.658ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:49136 req_id = be45feaf-8603-42f6-94bf-5c0d0d382baa roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/projects
22612024-11-06T00:19:37.660ZDEBGnexus (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:49136 req_id = be45feaf-8603-42f6-94bf-5c0d0d382baa resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) } result = Ok(()) uri = /v1/projects
22622024-11-06T00:19:37.660ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:49136 req_id = be45feaf-8603-42f6-94bf-5c0d0d382baa roles = RoleSet { roles: {} } uri = /v1/projects
22632024-11-06T00:19:37.660ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:49136 req_id = be45feaf-8603-42f6-94bf-5c0d0d382baa resource = Database result = Ok(()) uri = /v1/projects
22642024-11-06T00:19:37.662ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86334 local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:49136 req_id = be45feaf-8603-42f6-94bf-5c0d0d382baa response_code = 200 uri = /v1/projects
22652024-11-06T00:19:37.668ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22662024-11-06T00:19:37.668ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22672024-11-06T00:19:37.670ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22682024-11-06T00:19:37.670ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22692024-11-06T00:19:37.671ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22702024-11-06T00:19:37.672ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("token = \\"d27d5e9e4db716d98ec7ec234e0646949e77ad52\\"") } result = Ok(())
22712024-11-06T00:19:37.672ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22722024-11-06T00:19:37.673ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22732024-11-06T00:19:37.675ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22742024-11-06T00:19:37.675ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22752024-11-06T00:19:37.676ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22762024-11-06T00:19:37.676ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22772024-11-06T00:19:37.677ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22782024-11-06T00:19:37.677ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22792024-11-06T00:19:37.679ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22802024-11-06T00:19:37.680ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
22812024-11-06T00:19:37.680ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22822024-11-06T00:19:37.680ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22832024-11-06T00:19:37.681ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22842024-11-06T00:19:37.683ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("d27d5e9e4db716d98ec7ec234e0646949e77ad52") } result = Ok(())
22852024-11-06T00:19:37.683ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22862024-11-06T00:19:37.683ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22872024-11-06T00:19:37.697ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22882024-11-06T00:19:37.697ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22892024-11-06T00:19:37.698ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22902024-11-06T00:19:37.698ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22912024-11-06T00:19:37.700ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22922024-11-06T00:19:37.700ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22932024-11-06T00:19:37.701ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22942024-11-06T00:19:37.701ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22952024-11-06T00:19:37.703ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22962024-11-06T00:19:37.704ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
22972024-11-06T00:19:37.704ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22982024-11-06T00:19:37.704ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22992024-11-06T00:19:37.706ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23002024-11-06T00:19:37.706ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23012024-11-06T00:19:37.707ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23022024-11-06T00:19:37.707ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23032024-11-06T00:19:37.708ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23042024-11-06T00:19:37.710ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) } result = Ok(())
23052024-11-06T00:19:37.710ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = e4ebfd87-32e7-43b7-aa33-bf24499a1440 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
23062024-11-06T00:19:37.710ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = e4ebfd87-32e7-43b7-aa33-bf24499a1440 resource = Database result = Ok(()) uri = /v1/system/ip-pools
23072024-11-06T00:19:37.724ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = e4ebfd87-32e7-43b7-aa33-bf24499a1440 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
23082024-11-06T00:19:37.724ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = e4ebfd87-32e7-43b7-aa33-bf24499a1440 resource = Database result = Ok(()) uri = /v1/system/ip-pools
23092024-11-06T00:19:37.726ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = e4ebfd87-32e7-43b7-aa33-bf24499a1440 roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/system/ip-pools
23102024-11-06T00:19:37.728ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = e4ebfd87-32e7-43b7-aa33-bf24499a1440 resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools
23112024-11-06T00:19:37.728ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = e4ebfd87-32e7-43b7-aa33-bf24499a1440 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
23122024-11-06T00:19:37.729ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = e4ebfd87-32e7-43b7-aa33-bf24499a1440 resource = Database result = Ok(()) uri = /v1/system/ip-pools
23132024-11-06T00:19:37.733ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67942 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = e4ebfd87-32e7-43b7-aa33-bf24499a1440 response_code = 201 uri = /v1/system/ip-pools
23142024-11-06T00:19:37.737ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23152024-11-06T00:19:37.737ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23162024-11-06T00:19:37.738ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23172024-11-06T00:19:37.738ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23182024-11-06T00:19:37.739ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23192024-11-06T00:19:37.740ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("token = \\"d27d5e9e4db716d98ec7ec234e0646949e77ad52\\"") } result = Ok(())
23202024-11-06T00:19:37.740ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23212024-11-06T00:19:37.741ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23222024-11-06T00:19:37.742ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23232024-11-06T00:19:37.742ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23242024-11-06T00:19:37.743ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23252024-11-06T00:19:37.743ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23262024-11-06T00:19:37.744ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23272024-11-06T00:19:37.745ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23282024-11-06T00:19:37.746ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23292024-11-06T00:19:37.748ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
23302024-11-06T00:19:37.748ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23312024-11-06T00:19:37.748ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23322024-11-06T00:19:37.749ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23332024-11-06T00:19:37.750ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("d27d5e9e4db716d98ec7ec234e0646949e77ad52") } result = Ok(())
23342024-11-06T00:19:37.750ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23352024-11-06T00:19:37.750ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23362024-11-06T00:19:37.754ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23372024-11-06T00:19:37.754ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23382024-11-06T00:19:37.755ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23392024-11-06T00:19:37.755ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23402024-11-06T00:19:37.757ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23412024-11-06T00:19:37.757ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23422024-11-06T00:19:37.758ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23432024-11-06T00:19:37.759ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23442024-11-06T00:19:37.760ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23452024-11-06T00:19:37.761ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
23462024-11-06T00:19:37.761ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23472024-11-06T00:19:37.761ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23482024-11-06T00:19:37.762ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23492024-11-06T00:19:37.762ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23502024-11-06T00:19:37.764ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23512024-11-06T00:19:37.764ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23522024-11-06T00:19:37.765ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23532024-11-06T00:19:37.766ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) } result = Ok(())
23542024-11-06T00:19:37.766ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23552024-11-06T00:19:37.766ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23562024-11-06T00:19:37.769ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23572024-11-06T00:19:37.770ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23582024-11-06T00:19:37.779ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23592024-11-06T00:19:37.779ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23602024-11-06T00:19:37.781ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/system/ip-pools/default/silos
23612024-11-06T00:19:37.783ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 resource = IpPool { parent: Fleet, key: 0d48fa4d-0648-462a-a8d3-556f954047c2, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
23622024-11-06T00:19:37.783ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23632024-11-06T00:19:37.783ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23642024-11-06T00:19:37.785ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23652024-11-06T00:19:37.785ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23662024-11-06T00:19:37.788ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23672024-11-06T00:19:37.788ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23682024-11-06T00:19:37.790ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23692024-11-06T00:19:37.790ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23702024-11-06T00:19:37.792ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23712024-11-06T00:19:37.792ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23722024-11-06T00:19:37.795ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/system/ip-pools/default/silos
23732024-11-06T00:19:37.796ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
23742024-11-06T00:19:37.796ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23752024-11-06T00:19:37.796ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23762024-11-06T00:19:37.798ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23772024-11-06T00:19:37.799ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23782024-11-06T00:19:37.801ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/system/ip-pools/default/silos
23792024-11-06T00:19:37.803ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools/default/silos
23802024-11-06T00:19:37.803ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23812024-11-06T00:19:37.803ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23822024-11-06T00:19:37.865ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128415 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f223b2ac-28dc-4b09-9d7b-21ec3530b975 response_code = 201 uri = /v1/system/ip-pools/default/silos
23832024-11-06T00:19:37.868ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23842024-11-06T00:19:37.868ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23852024-11-06T00:19:37.877ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23862024-11-06T00:19:37.877ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23872024-11-06T00:19:37.879ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23882024-11-06T00:19:37.880ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("token = \\"d27d5e9e4db716d98ec7ec234e0646949e77ad52\\"") } result = Ok(())
23892024-11-06T00:19:37.880ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23902024-11-06T00:19:37.881ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23912024-11-06T00:19:37.882ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23922024-11-06T00:19:37.882ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23932024-11-06T00:19:37.884ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23942024-11-06T00:19:37.884ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23952024-11-06T00:19:37.885ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23962024-11-06T00:19:37.886ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23972024-11-06T00:19:37.887ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23982024-11-06T00:19:37.888ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
23992024-11-06T00:19:37.888ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24002024-11-06T00:19:37.888ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24012024-11-06T00:19:37.890ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24022024-11-06T00:19:37.891ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("d27d5e9e4db716d98ec7ec234e0646949e77ad52") } result = Ok(())
24032024-11-06T00:19:37.891ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24042024-11-06T00:19:37.891ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24052024-11-06T00:19:37.896ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24062024-11-06T00:19:37.897ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24072024-11-06T00:19:37.898ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24082024-11-06T00:19:37.898ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24092024-11-06T00:19:37.899ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24102024-11-06T00:19:37.900ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24112024-11-06T00:19:37.901ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24122024-11-06T00:19:37.901ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24132024-11-06T00:19:37.902ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24142024-11-06T00:19:37.904ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
24152024-11-06T00:19:37.904ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24162024-11-06T00:19:37.904ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24172024-11-06T00:19:37.905ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24182024-11-06T00:19:37.905ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24192024-11-06T00:19:37.907ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24202024-11-06T00:19:37.907ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24212024-11-06T00:19:37.908ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24222024-11-06T00:19:37.909ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) } result = Ok(())
24232024-11-06T00:19:37.909ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
24242024-11-06T00:19:37.909ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24252024-11-06T00:19:37.918ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
24262024-11-06T00:19:37.918ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24272024-11-06T00:19:37.921ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
24282024-11-06T00:19:37.921ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24292024-11-06T00:19:37.923ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
24302024-11-06T00:19:37.926ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de resource = IpPool { parent: Fleet, key: 0d48fa4d-0648-462a-a8d3-556f954047c2, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24312024-11-06T00:19:37.926ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
24322024-11-06T00:19:37.926ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24332024-11-06T00:19:37.928ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
24342024-11-06T00:19:37.928ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24352024-11-06T00:19:37.928ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
24362024-11-06T00:19:37.929ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24372024-11-06T00:19:37.930ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
24382024-11-06T00:19:37.930ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24392024-11-06T00:19:37.933ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
24402024-11-06T00:19:37.934ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de resource = IpPool { parent: Fleet, key: 0d48fa4d-0648-462a-a8d3-556f954047c2, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
24412024-11-06T00:19:37.951ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84091 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 1181ab90-478b-4800-a6be-df5d74f3d0de response_code = 201 uri = /v1/system/ip-pools/default/ranges/add
24422024-11-06T00:19:37.953ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24432024-11-06T00:19:37.953ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24442024-11-06T00:19:37.954ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24452024-11-06T00:19:37.954ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24462024-11-06T00:19:37.956ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24472024-11-06T00:19:37.957ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("token = \\"d27d5e9e4db716d98ec7ec234e0646949e77ad52\\"") } result = Ok(())
24482024-11-06T00:19:37.958ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24492024-11-06T00:19:37.958ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24502024-11-06T00:19:37.959ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24512024-11-06T00:19:37.959ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24522024-11-06T00:19:37.960ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24532024-11-06T00:19:37.960ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24542024-11-06T00:19:37.962ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24552024-11-06T00:19:37.962ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24562024-11-06T00:19:37.964ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24572024-11-06T00:19:37.965ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
24582024-11-06T00:19:37.965ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24592024-11-06T00:19:37.965ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24602024-11-06T00:19:37.966ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24612024-11-06T00:19:37.967ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("d27d5e9e4db716d98ec7ec234e0646949e77ad52") } result = Ok(())
24622024-11-06T00:19:37.967ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24632024-11-06T00:19:37.968ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24642024-11-06T00:19:37.971ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24652024-11-06T00:19:37.972ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24662024-11-06T00:19:37.973ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24672024-11-06T00:19:37.973ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24682024-11-06T00:19:37.974ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24692024-11-06T00:19:37.974ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24702024-11-06T00:19:37.976ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24712024-11-06T00:19:37.976ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24722024-11-06T00:19:37.977ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24732024-11-06T00:19:37.978ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
24742024-11-06T00:19:37.978ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24752024-11-06T00:19:37.978ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24762024-11-06T00:19:37.980ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24772024-11-06T00:19:37.980ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24782024-11-06T00:19:37.981ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24792024-11-06T00:19:37.981ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24802024-11-06T00:19:37.983ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24812024-11-06T00:19:37.984ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) } result = Ok(())
24822024-11-06T00:19:37.984ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24832024-11-06T00:19:37.984ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24842024-11-06T00:19:37.986ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24852024-11-06T00:19:37.986ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24862024-11-06T00:19:37.988ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24872024-11-06T00:19:37.988ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24882024-11-06T00:19:37.991ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24892024-11-06T00:19:37.991ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24902024-11-06T00:19:37.992ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/system/silos/recovery/quotas
24912024-11-06T00:19:37.994ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
24922024-11-06T00:19:37.994ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24932024-11-06T00:19:37.994ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24942024-11-06T00:19:37.996ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24952024-11-06T00:19:37.996ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24962024-11-06T00:19:37.999ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24972024-11-06T00:19:37.999ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24982024-11-06T00:19:38.002ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/system/silos/recovery/quotas
24992024-11-06T00:19:38.003ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
25002024-11-06T00:19:38.003ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
25012024-11-06T00:19:38.003ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
25022024-11-06T00:19:38.008ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55277 local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:49136 req_id = ed953db1-187c-4ce9-878d-01aeac44ab84 response_code = 200 uri = /v1/system/silos/recovery/quotas
25032024-11-06T00:19:38.010ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25042024-11-06T00:19:38.010ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25052024-11-06T00:19:38.011ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25062024-11-06T00:19:38.011ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25072024-11-06T00:19:38.013ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25082024-11-06T00:19:38.014ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("token = \\"d27d5e9e4db716d98ec7ec234e0646949e77ad52\\"") } result = Ok(())
25092024-11-06T00:19:38.014ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25102024-11-06T00:19:38.014ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25112024-11-06T00:19:38.015ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25122024-11-06T00:19:38.016ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25132024-11-06T00:19:38.017ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25142024-11-06T00:19:38.017ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25152024-11-06T00:19:38.018ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25162024-11-06T00:19:38.019ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25172024-11-06T00:19:38.020ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25182024-11-06T00:19:38.021ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
25192024-11-06T00:19:38.021ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25202024-11-06T00:19:38.021ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25212024-11-06T00:19:38.022ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25222024-11-06T00:19:38.023ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("d27d5e9e4db716d98ec7ec234e0646949e77ad52") } result = Ok(())
25232024-11-06T00:19:38.023ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25242024-11-06T00:19:38.023ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25252024-11-06T00:19:38.028ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25262024-11-06T00:19:38.028ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25272024-11-06T00:19:38.030ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25282024-11-06T00:19:38.030ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25292024-11-06T00:19:38.031ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25302024-11-06T00:19:38.031ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25312024-11-06T00:19:38.032ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25322024-11-06T00:19:38.033ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25332024-11-06T00:19:38.034ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25342024-11-06T00:19:38.035ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
25352024-11-06T00:19:38.035ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25362024-11-06T00:19:38.035ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25372024-11-06T00:19:38.037ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25382024-11-06T00:19:38.037ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25392024-11-06T00:19:38.038ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25402024-11-06T00:19:38.038ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25412024-11-06T00:19:38.041ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25422024-11-06T00:19:38.043ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) } result = Ok(())
25432024-11-06T00:19:38.043ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f753708b-f1c5-4fb5-b907-ec19ffc919a2 roles = RoleSet { roles: {} } uri = /v1/projects
25442024-11-06T00:19:38.043ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f753708b-f1c5-4fb5-b907-ec19ffc919a2 resource = Database result = Ok(()) uri = /v1/projects
25452024-11-06T00:19:38.045ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f753708b-f1c5-4fb5-b907-ec19ffc919a2 roles = RoleSet { roles: {} } uri = /v1/projects
25462024-11-06T00:19:38.045ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f753708b-f1c5-4fb5-b907-ec19ffc919a2 resource = Database result = Ok(()) uri = /v1/projects
25472024-11-06T00:19:38.047ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f753708b-f1c5-4fb5-b907-ec19ffc919a2 roles = RoleSet { roles: {} } uri = /v1/projects
25482024-11-06T00:19:38.047ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f753708b-f1c5-4fb5-b907-ec19ffc919a2 resource = Database result = Ok(()) uri = /v1/projects
25492024-11-06T00:19:38.050ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f753708b-f1c5-4fb5-b907-ec19ffc919a2 roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/projects
25502024-11-06T00:19:38.051ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f753708b-f1c5-4fb5-b907-ec19ffc919a2 resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) } result = Ok(()) uri = /v1/projects
25512024-11-06T00:19:38.052ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create
25522024-11-06T00:19:38.052ZINFOnexus (SEC): saga create dag = {"end_node":19,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[14,15,null],[15,16,null],[2,3,null],[16,17,null],[18,0,null],[17,19,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultInternetGatewayId","name":"default_internet_gateway_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_create_gateway","label":"VpcCreateGateway","name":"gateway"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"538efd2f-b8ed-4a95-91b1-680b63627575","lookup_type":{"ById":"538efd2f-b8ed-4a95-91b1-680b63627575"},"parent":null},"project_create":{"description":"","name":"proj-93c324908ee"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","silo_user_id":"d5ad8f35-a929-4fe6-9dd1-b6f886fec39e"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"project-create","start_node":18} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25532024-11-06T00:19:38.052ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create
25542024-11-06T00:19:38.092ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create
25552024-11-06T00:19:38.092ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25562024-11-06T00:19:38.092ZDEBGnexus (SEC): saga log event new_state = N018 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25572024-11-06T00:19:38.092ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 18 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
25582024-11-06T00:19:38.104ZDEBGnexus (SEC): saga log event new_state = N018 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25592024-11-06T00:19:38.104ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 18 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
25602024-11-06T00:19:38.118ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25612024-11-06T00:19:38.118ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
25622024-11-06T00:19:38.137ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = ProjectCreateRecord
25632024-11-06T00:19:38.138ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = ProjectCreateRecord
25642024-11-06T00:19:38.141ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = ProjectCreateRecord
25652024-11-06T00:19:38.141ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = ProjectCreateRecord
25662024-11-06T00:19:38.144ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = ProjectCreateRecord
25672024-11-06T00:19:38.144ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = ProjectCreateRecord
25682024-11-06T00:19:38.146ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = ProjectCreateRecord
25692024-11-06T00:19:38.148ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) } result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = ProjectCreateRecord
25702024-11-06T00:19:38.150ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = ProjectCreateRecord
25712024-11-06T00:19:38.150ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = ProjectCreateRecord
25722024-11-06T00:19:38.165ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25732024-11-06T00:19:38.165ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "name": String("proj-93c324908ee"), "time_created": String("2024-11-06T00:19:38.137967Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.137967Z")}, "rcgen": Number(1), "silo_id": String("538efd2f-b8ed-4a95-91b1-680b63627575")}]) node_id = 0 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
25742024-11-06T00:19:38.169ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25752024-11-06T00:19:38.169ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
25762024-11-06T00:19:38.182ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25772024-11-06T00:19:38.182ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "silo_user_id": String("d5ad8f35-a929-4fe6-9dd1-b6f886fec39e")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fdb2:5ac8:2676::/48"), "name": String("default")}}) node_id = 1 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
25782024-11-06T00:19:38.192ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25792024-11-06T00:19:38.192ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
25802024-11-06T00:19:38.196ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25812024-11-06T00:19:38.196ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
25822024-11-06T00:19:38.200ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25832024-11-06T00:19:38.200ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
25842024-11-06T00:19:38.207ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25852024-11-06T00:19:38.207ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da")) node_id = 3 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
25862024-11-06T00:19:38.210ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25872024-11-06T00:19:38.210ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
25882024-11-06T00:19:38.215ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25892024-11-06T00:19:38.215ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("3fa07511-3298-4f26-ac83-e55e431c18f1")) node_id = 4 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
25902024-11-06T00:19:38.223ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25912024-11-06T00:19:38.223ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
25922024-11-06T00:19:38.229ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25932024-11-06T00:19:38.229ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("f8e853af-6fb0-44cf-95e6-4602f11615be")) node_id = 5 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
25942024-11-06T00:19:38.234ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25952024-11-06T00:19:38.234ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
25962024-11-06T00:19:38.238ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25972024-11-06T00:19:38.238ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("47de602e-ade6-495d-9e15-96891375000a")) node_id = 6 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
25982024-11-06T00:19:38.242ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
25992024-11-06T00:19:38.242ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
26002024-11-06T00:19:38.246ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
26012024-11-06T00:19:38.246ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("e79fdd3f-d6d9-4429-b9c6-0de0d0028da5")) node_id = 7 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
26022024-11-06T00:19:38.248ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
26032024-11-06T00:19:38.248ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
26042024-11-06T00:19:38.253ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
26052024-11-06T00:19:38.253ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("1ade3827-28af-4bd4-875f-4002c215ba12")) node_id = 8 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
26062024-11-06T00:19:38.257ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
26072024-11-06T00:19:38.257ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
26082024-11-06T00:19:38.261ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateVpc
26092024-11-06T00:19:38.261ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateVpc
26102024-11-06T00:19:38.264ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateVpc
26112024-11-06T00:19:38.264ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateVpc
26122024-11-06T00:19:38.265ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateVpc
26132024-11-06T00:19:38.266ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateVpc
26142024-11-06T00:19:38.268ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateVpc
26152024-11-06T00:19:38.269ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateVpc
26162024-11-06T00:19:38.271ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateVpc
26172024-11-06T00:19:38.274ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") } result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateVpc
26182024-11-06T00:19:38.274ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateVpc
26192024-11-06T00:19:38.274ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateVpc
26202024-11-06T00:19:38.287ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
26212024-11-06T00:19:38.287ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da"), "name": String("default"), "time_created": String("2024-11-06T00:19:38.261409Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.261409Z")}, "ipv6_prefix": String("fdb2:5ac8:2676::/48"), "project_id": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "subnet_gen": Number(1), "system_router_id": String("3fa07511-3298-4f26-ac83-e55e431c18f1"), "vni": Number(8644902)}]) node_id = 9 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
26222024-11-06T00:19:38.291ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
26232024-11-06T00:19:38.291ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
26242024-11-06T00:19:38.295ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateRouter
26252024-11-06T00:19:38.295ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateRouter
26262024-11-06T00:19:38.297ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateRouter
26272024-11-06T00:19:38.298ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateRouter
26282024-11-06T00:19:38.300ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateRouter
26292024-11-06T00:19:38.300ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateRouter
26302024-11-06T00:19:38.302ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateRouter
26312024-11-06T00:19:38.302ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateRouter
26322024-11-06T00:19:38.305ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateRouter
26332024-11-06T00:19:38.308ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") }, key: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, lookup_type: ByName("default") } result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateRouter
26342024-11-06T00:19:38.308ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateRouter
26352024-11-06T00:19:38.308ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateRouter
26362024-11-06T00:19:38.339ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
26372024-11-06T00:19:38.339ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("3fa07511-3298-4f26-ac83-e55e431c18f1"), "lookup_type": Object {"ById": String("3fa07511-3298-4f26-ac83-e55e431c18f1")}, "parent": Object {"key": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}}}) node_id = 10 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
26382024-11-06T00:19:38.343ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
26392024-11-06T00:19:38.343ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
26402024-11-06T00:19:38.348ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV4Route
26412024-11-06T00:19:38.348ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV4Route
26422024-11-06T00:19:38.350ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV4Route
26432024-11-06T00:19:38.350ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV4Route
26442024-11-06T00:19:38.353ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV4Route
26452024-11-06T00:19:38.353ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV4Route
26462024-11-06T00:19:38.355ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV4Route
26472024-11-06T00:19:38.355ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV4Route
26482024-11-06T00:19:38.357ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV4Route
26492024-11-06T00:19:38.361ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") }, key: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, lookup_type: ByName("default") }, key: 3fa07511-3298-4f26-ac83-e55e431c18f1, lookup_type: ById(3fa07511-3298-4f26-ac83-e55e431c18f1) } result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV4Route
26502024-11-06T00:19:38.361ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV4Route
26512024-11-06T00:19:38.361ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV4Route
26522024-11-06T00:19:38.476ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
26532024-11-06T00:19:38.476ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
26542024-11-06T00:19:38.482ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
26552024-11-06T00:19:38.482ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
26562024-11-06T00:19:38.486ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV6Route
26572024-11-06T00:19:38.486ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV6Route
26582024-11-06T00:19:38.488ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV6Route
26592024-11-06T00:19:38.488ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV6Route
26602024-11-06T00:19:38.491ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV6Route
26612024-11-06T00:19:38.491ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV6Route
26622024-11-06T00:19:38.494ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV6Route
26632024-11-06T00:19:38.494ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV6Route
26642024-11-06T00:19:38.497ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV6Route
26652024-11-06T00:19:38.500ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") }, key: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, lookup_type: ByName("default") }, key: 3fa07511-3298-4f26-ac83-e55e431c18f1, lookup_type: ById(3fa07511-3298-4f26-ac83-e55e431c18f1) } result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV6Route
26662024-11-06T00:19:38.500ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV6Route
26672024-11-06T00:19:38.500ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateV6Route
26682024-11-06T00:19:38.610ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
26692024-11-06T00:19:38.610ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
26702024-11-06T00:19:38.614ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
26712024-11-06T00:19:38.614ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
26722024-11-06T00:19:38.617ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateSubnet
26732024-11-06T00:19:38.618ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateSubnet
26742024-11-06T00:19:38.620ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateSubnet
26752024-11-06T00:19:38.620ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateSubnet
26762024-11-06T00:19:38.623ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateSubnet
26772024-11-06T00:19:38.623ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateSubnet
26782024-11-06T00:19:38.625ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateSubnet
26792024-11-06T00:19:38.626ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateSubnet
26802024-11-06T00:19:38.627ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateSubnet
26812024-11-06T00:19:38.630ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") }, key: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, lookup_type: ByName("default") } result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateSubnet
26822024-11-06T00:19:38.637ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateSubnet
26832024-11-06T00:19:38.637ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateSubnet
26842024-11-06T00:19:38.653ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateSubnet
26852024-11-06T00:19:38.653ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateSubnet
26862024-11-06T00:19:38.770ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
26872024-11-06T00:19:38.770ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("e79fdd3f-d6d9-4429-b9c6-0de0d0028da5"), "lookup_type": Object {"ById": String("e79fdd3f-d6d9-4429-b9c6-0de0d0028da5")}, "parent": Object {"key": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("e79fdd3f-d6d9-4429-b9c6-0de0d0028da5"), "name": String("default"), "time_created": String("2024-11-06T00:19:38.617951Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.617951Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fdb2:5ac8:2676::/64"), "rcgen": Number(1), "vpc_id": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da")}]) node_id = 13 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
26882024-11-06T00:19:38.776ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
26892024-11-06T00:19:38.776ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
26902024-11-06T00:19:38.780ZDEBGnexus: default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: e0879098-3aeb-4b08-99fc-b8ee2ce6cf7c, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2024-11-06T00:19:38.780372968Z, time_modified: 2024-11-06T00:19:38.780372968Z, time_deleted: None }, vpc_id: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 8ae6e4c8-033a-4793-9c89-bc72bbcd3e67, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2024-11-06T00:19:38.780375498Z, time_modified: 2024-11-06T00:19:38.780375498Z, time_deleted: None }, vpc_id: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: f2837fa0-4600-4269-a356-235e8fc3c989, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2024-11-06T00:19:38.780376328Z, time_modified: 2024-11-06T00:19:38.780376328Z, time_deleted: None }, vpc_id: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
26912024-11-06T00:19:38.780ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcUpdateFirewall
26922024-11-06T00:19:38.780ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcUpdateFirewall
26932024-11-06T00:19:38.783ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcUpdateFirewall
26942024-11-06T00:19:38.783ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcUpdateFirewall
26952024-11-06T00:19:38.785ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcUpdateFirewall
26962024-11-06T00:19:38.786ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcUpdateFirewall
26972024-11-06T00:19:38.788ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcUpdateFirewall
26982024-11-06T00:19:38.788ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcUpdateFirewall
26992024-11-06T00:19:38.790ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcUpdateFirewall
27002024-11-06T00:19:38.793ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") }, key: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, lookup_type: ByName("default") } result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcUpdateFirewall
27012024-11-06T00:19:38.793ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcUpdateFirewall
27022024-11-06T00:19:38.793ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcUpdateFirewall
27032024-11-06T00:19:38.855ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
27042024-11-06T00:19:38.855ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("e0879098-3aeb-4b08-99fc-b8ee2ce6cf7c"), "name": String("allow-internal-inbound"), "time_created": String("2024-11-06T00:19:38.780372968Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.780372968Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("8ae6e4c8-033a-4793-9c89-bc72bbcd3e67"), "name": String("allow-ssh"), "time_created": String("2024-11-06T00:19:38.780375498Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.780375498Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("f2837fa0-4600-4269-a356-235e8fc3c989"), "name": String("allow-icmp"), "time_created": String("2024-11-06T00:19:38.780376328Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.780376328Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da")}]) node_id = 14 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
27052024-11-06T00:19:38.870ZDEBGnexus (SEC): saga log event new_state = N015 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
27062024-11-06T00:19:38.870ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 15 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
27072024-11-06T00:19:38.884ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27082024-11-06T00:19:38.884ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27092024-11-06T00:19:38.887ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27102024-11-06T00:19:38.887ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27112024-11-06T00:19:38.889ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27122024-11-06T00:19:38.890ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27132024-11-06T00:19:38.892ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27142024-11-06T00:19:38.892ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27152024-11-06T00:19:38.895ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27162024-11-06T00:19:38.898ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") }, key: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, lookup_type: ByName("default") } result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27172024-11-06T00:19:38.898ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27182024-11-06T00:19:38.898ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27192024-11-06T00:19:38.917ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27202024-11-06T00:19:38.917ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27212024-11-06T00:19:38.925ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27222024-11-06T00:19:38.925ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27232024-11-06T00:19:38.929ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27242024-11-06T00:19:38.929ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27252024-11-06T00:19:38.930ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27262024-11-06T00:19:38.931ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27272024-11-06T00:19:38.933ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27282024-11-06T00:19:38.934ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27292024-11-06T00:19:38.936ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27302024-11-06T00:19:38.936ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27312024-11-06T00:19:38.939ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27322024-11-06T00:19:38.942ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") }, key: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, lookup_type: ByName("default") }, key: 1ade3827-28af-4bd4-875f-4002c215ba12, lookup_type: ById(1ade3827-28af-4bd4-875f-4002c215ba12) } result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27332024-11-06T00:19:38.942ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27342024-11-06T00:19:38.942ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcCreateGateway
27352024-11-06T00:19:38.963ZDEBGnexus (SEC): saga log event new_state = N015 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
27362024-11-06T00:19:38.963ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("1ade3827-28af-4bd4-875f-4002c215ba12"), "lookup_type": Object {"ById": String("1ade3827-28af-4bd4-875f-4002c215ba12")}, "parent": Object {"key": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}}}) node_id = 15 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
27372024-11-06T00:19:38.969ZDEBGnexus (SEC): saga log event new_state = N016 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
27382024-11-06T00:19:38.969ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 16 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
27392024-11-06T00:19:38.975ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27402024-11-06T00:19:38.975ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27412024-11-06T00:19:38.977ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27422024-11-06T00:19:38.977ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27432024-11-06T00:19:38.978ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27442024-11-06T00:19:38.979ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27452024-11-06T00:19:38.981ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27462024-11-06T00:19:38.982ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27472024-11-06T00:19:38.983ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27482024-11-06T00:19:38.984ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27492024-11-06T00:19:38.986ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27502024-11-06T00:19:38.986ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27512024-11-06T00:19:38.989ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27522024-11-06T00:19:38.989ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27532024-11-06T00:19:38.991ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27542024-11-06T00:19:38.994ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ById(a7cafe05-827c-404c-8be6-d16f88bf31eb) }, key: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, lookup_type: ByName("default") } result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27552024-11-06T00:19:38.994ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27562024-11-06T00:19:38.994ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27572024-11-06T00:19:38.996ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27582024-11-06T00:19:38.997ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27592024-11-06T00:19:38.998ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27602024-11-06T00:19:38.999ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27612024-11-06T00:19:39.001ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27622024-11-06T00:19:39.001ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27632024-11-06T00:19:39.003ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27642024-11-06T00:19:39.006ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ById(a7cafe05-827c-404c-8be6-d16f88bf31eb) }, key: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, lookup_type: ByName("default") } result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27652024-11-06T00:19:39.006ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27662024-11-06T00:19:39.006ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_node = VpcNotifySleds
27672024-11-06T00:19:39.012ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
27682024-11-06T00:19:39.012ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = []
27692024-11-06T00:19:39.012ZDEBGnexus: resolved 0 rules for sleds
27702024-11-06T00:19:39.034ZDEBGnexus: resolved sleds for vpc default vpc_to_sled = []
27712024-11-06T00:19:39.034ZDEBGnexus: sending firewall rules to sled agents
27722024-11-06T00:19:39.034ZINFOnexus: updated firewall rules on 0 sleds file = nexus/networking/src/firewall_rules.rs:496
27732024-11-06T00:19:39.034ZDEBGnexus (SEC): saga log event new_state = N016 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
27742024-11-06T00:19:39.034ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 16 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
27752024-11-06T00:19:39.037ZDEBGnexus (SEC): saga log event new_state = N017 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
27762024-11-06T00:19:39.037ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 17 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
27772024-11-06T00:19:39.041ZDEBGnexus (SEC): saga log event new_state = N017 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
27782024-11-06T00:19:39.041ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 17 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
27792024-11-06T00:19:39.045ZDEBGnexus (SEC): saga log event new_state = N019 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
27802024-11-06T00:19:39.045ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 19 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
27812024-11-06T00:19:39.050ZDEBGnexus (SEC): saga log event new_state = N019 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
27822024-11-06T00:19:39.050ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 19 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
27832024-11-06T00:19:39.053ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
27842024-11-06T00:19:39.053ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
27852024-11-06T00:19:39.126ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
27862024-11-06T00:19:39.126ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f saga_name = project-create saga_result = SagaResult { saga_id: 6e5362cd-8504-4879-8873-1cba0ccb9b1f, saga_log: SagaLog { saga_id: 6e5362cd-8504-4879-8873-1cba0ccb9b1f, unwinding: false, events: [N018 started, N018 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N016 started, N016 succeeded, N017 started, N017 succeeded, N019 started, N019 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "name": String("proj-93c324908ee"), "time_created": String("2024-11-06T00:19:38.137967Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.137967Z")}, "rcgen": Number(1), "silo_id": String("538efd2f-b8ed-4a95-91b1-680b63627575")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "silo_user_id": String("d5ad8f35-a929-4fe6-9dd1-b6f886fec39e")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fdb2:5ac8:2676::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da")), 4: Succeeded(String("3fa07511-3298-4f26-ac83-e55e431c18f1")), 5: Succeeded(String("f8e853af-6fb0-44cf-95e6-4602f11615be")), 6: Succeeded(String("47de602e-ade6-495d-9e15-96891375000a")), 7: Succeeded(String("e79fdd3f-d6d9-4429-b9c6-0de0d0028da5")), 8: Succeeded(String("1ade3827-28af-4bd4-875f-4002c215ba12")), 9: Succeeded(Array [Object {"key": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da"), "name": String("default"), "time_created": String("2024-11-06T00:19:38.261409Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.261409Z")}, "ipv6_prefix": String("fdb2:5ac8:2676::/48"), "project_id": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "subnet_gen": Number(1), "system_router_id": String("3fa07511-3298-4f26-ac83-e55e431c18f1"), "vni": Number(8644902)}]), 10: Succeeded(Object {"key": String("3fa07511-3298-4f26-ac83-e55e431c18f1"), "lookup_type": Object {"ById": String("3fa07511-3298-4f26-ac83-e55e431c18f1")}, "parent": Object {"key": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}}}), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Array [Object {"key": String("e79fdd3f-d6d9-4429-b9c6-0de0d0028da5"), "lookup_type": Object {"ById": String("e79fdd3f-d6d9-4429-b9c6-0de0d0028da5")}, "parent": Object {"key": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("e79fdd3f-d6d9-4429-b9c6-0de0d0028da5"), "name": String("default"), "time_created": String("2024-11-06T00:19:38.617951Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.617951Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fdb2:5ac8:2676::/64"), "rcgen": Number(1), "vpc_id": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da")}]), 14: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("e0879098-3aeb-4b08-99fc-b8ee2ce6cf7c"), "name": String("allow-internal-inbound"), "time_created": String("2024-11-06T00:19:38.780372968Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.780372968Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("8ae6e4c8-033a-4793-9c89-bc72bbcd3e67"), "name": String("allow-ssh"), "time_created": String("2024-11-06T00:19:38.780375498Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.780375498Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("f2837fa0-4600-4269-a356-235e8fc3c989"), "name": String("allow-icmp"), "time_created": String("2024-11-06T00:19:38.780376328Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.780376328Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da")}]), 15: Succeeded(Object {"key": String("1ade3827-28af-4bd4-875f-4002c215ba12"), "lookup_type": Object {"ById": String("1ade3827-28af-4bd4-875f-4002c215ba12")}, "parent": Object {"key": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}}}), 16: Succeeded(Null), 17: Succeeded(Null), 18: Succeeded(Null), 19: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_internet_gateway_id": String("1ade3827-28af-4bd4-875f-4002c215ba12"), "default_subnet_id": String("e79fdd3f-d6d9-4429-b9c6-0de0d0028da5"), "default_v4_route_id": String("f8e853af-6fb0-44cf-95e6-4602f11615be"), "default_v6_route_id": String("47de602e-ade6-495d-9e15-96891375000a"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("e0879098-3aeb-4b08-99fc-b8ee2ce6cf7c"), "name": String("allow-internal-inbound"), "time_created": String("2024-11-06T00:19:38.780372968Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.780372968Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("8ae6e4c8-033a-4793-9c89-bc72bbcd3e67"), "name": String("allow-ssh"), "time_created": String("2024-11-06T00:19:38.780375498Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.780375498Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("f2837fa0-4600-4269-a356-235e8fc3c989"), "name": String("allow-icmp"), "time_created": String("2024-11-06T00:19:38.780376328Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.780376328Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da")}], "gateway": Object {"key": String("1ade3827-28af-4bd4-875f-4002c215ba12"), "lookup_type": Object {"ById": String("1ade3827-28af-4bd4-875f-4002c215ba12")}, "parent": Object {"key": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}}}, "no_result": Null, "project": Array [Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "name": String("proj-93c324908ee"), "time_created": String("2024-11-06T00:19:38.137967Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.137967Z")}, "rcgen": Number(1), "silo_id": String("538efd2f-b8ed-4a95-91b1-680b63627575")}], "route4": Null, "route6": Null, "router": Object {"key": String("3fa07511-3298-4f26-ac83-e55e431c18f1"), "lookup_type": Object {"ById": String("3fa07511-3298-4f26-ac83-e55e431c18f1")}, "parent": Object {"key": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("e79fdd3f-d6d9-4429-b9c6-0de0d0028da5"), "lookup_type": Object {"ById": String("e79fdd3f-d6d9-4429-b9c6-0de0d0028da5")}, "parent": Object {"key": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("e79fdd3f-d6d9-4429-b9c6-0de0d0028da5"), "name": String("default"), "time_created": String("2024-11-06T00:19:38.617951Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:38.617951Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fdb2:5ac8:2676::/64"), "rcgen": Number(1), "vpc_id": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da")}], "system_router_id": String("3fa07511-3298-4f26-ac83-e55e431c18f1"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "lookup_type": Object {"ByName": String("proj-93c324908ee")}, "parent": Object {"key": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "lookup_type": Object {"ById": String("538efd2f-b8ed-4a95-91b1-680b63627575")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "silo_user_id": String("d5ad8f35-a929-4fe6-9dd1-b6f886fec39e")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fdb2:5ac8:2676::/48"), "name": String("default")}}, "vpc_id": String("40fab85c-69ed-4f58-b3fd-2c6c03bdc0da")} }) }
27872024-11-06T00:19:39.126ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1115910 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = f753708b-f1c5-4fb5-b907-ec19ffc919a2 response_code = 201 uri = /v1/projects
27882024-11-06T00:19:39.128ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27892024-11-06T00:19:39.129ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27902024-11-06T00:19:39.130ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27912024-11-06T00:19:39.130ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27922024-11-06T00:19:39.132ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27932024-11-06T00:19:39.133ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("token = \\"d27d5e9e4db716d98ec7ec234e0646949e77ad52\\"") } result = Ok(())
27942024-11-06T00:19:39.133ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27952024-11-06T00:19:39.133ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27962024-11-06T00:19:39.135ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27972024-11-06T00:19:39.135ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27982024-11-06T00:19:39.136ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27992024-11-06T00:19:39.136ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28002024-11-06T00:19:39.138ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28012024-11-06T00:19:39.138ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28022024-11-06T00:19:39.139ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28032024-11-06T00:19:39.140ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
28042024-11-06T00:19:39.140ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28052024-11-06T00:19:39.140ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28062024-11-06T00:19:39.142ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28072024-11-06T00:19:39.143ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("d27d5e9e4db716d98ec7ec234e0646949e77ad52") } result = Ok(())
28082024-11-06T00:19:39.143ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28092024-11-06T00:19:39.143ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28102024-11-06T00:19:39.151ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28112024-11-06T00:19:39.151ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28122024-11-06T00:19:39.152ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28132024-11-06T00:19:39.152ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28142024-11-06T00:19:39.154ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28152024-11-06T00:19:39.154ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28162024-11-06T00:19:39.155ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28172024-11-06T00:19:39.155ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28182024-11-06T00:19:39.157ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28192024-11-06T00:19:39.158ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
28202024-11-06T00:19:39.158ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28212024-11-06T00:19:39.158ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28222024-11-06T00:19:39.159ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28232024-11-06T00:19:39.160ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28242024-11-06T00:19:39.161ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28252024-11-06T00:19:39.161ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28262024-11-06T00:19:39.162ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28272024-11-06T00:19:39.163ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) } result = Ok(())
28282024-11-06T00:19:39.163ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 9674837a-75f3-4d5a-8b3b-236f30a44bcf roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-93c324908ee
28292024-11-06T00:19:39.163ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 9674837a-75f3-4d5a-8b3b-236f30a44bcf resource = Database result = Ok(()) uri = /v1/disks?project=proj-93c324908ee
28302024-11-06T00:19:39.165ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 9674837a-75f3-4d5a-8b3b-236f30a44bcf roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-93c324908ee
28312024-11-06T00:19:39.165ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 9674837a-75f3-4d5a-8b3b-236f30a44bcf resource = Database result = Ok(()) uri = /v1/disks?project=proj-93c324908ee
28322024-11-06T00:19:39.170ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 9674837a-75f3-4d5a-8b3b-236f30a44bcf roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-93c324908ee
28332024-11-06T00:19:39.170ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 9674837a-75f3-4d5a-8b3b-236f30a44bcf resource = Database result = Ok(()) uri = /v1/disks?project=proj-93c324908ee
28342024-11-06T00:19:39.173ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 9674837a-75f3-4d5a-8b3b-236f30a44bcf roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-93c324908ee
28352024-11-06T00:19:39.174ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 9674837a-75f3-4d5a-8b3b-236f30a44bcf resource = Database result = Ok(()) uri = /v1/disks?project=proj-93c324908ee
28362024-11-06T00:19:39.175ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 9674837a-75f3-4d5a-8b3b-236f30a44bcf roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-93c324908ee
28372024-11-06T00:19:39.176ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 9674837a-75f3-4d5a-8b3b-236f30a44bcf resource = Database result = Ok(()) uri = /v1/disks?project=proj-93c324908ee
28382024-11-06T00:19:39.178ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 9674837a-75f3-4d5a-8b3b-236f30a44bcf roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-93c324908ee
28392024-11-06T00:19:39.178ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 9674837a-75f3-4d5a-8b3b-236f30a44bcf resource = Database result = Ok(()) uri = /v1/disks?project=proj-93c324908ee
28402024-11-06T00:19:39.181ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 9674837a-75f3-4d5a-8b3b-236f30a44bcf roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/disks?project=proj-93c324908ee
28412024-11-06T00:19:39.183ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 9674837a-75f3-4d5a-8b3b-236f30a44bcf resource = Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") } result = Ok(()) uri = /v1/disks?project=proj-93c324908ee
28422024-11-06T00:19:39.183ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create
28432024-11-06T00:19:39.183ZINFOnexus (SEC): saga create dag = {"end_node":10,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,0,null],[8,10,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateDiskId","name":"disk_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVolumeId","name":"volume_id"}},{"Action":{"action_name":"disk_create.create_disk_record","label":"CreateDiskRecord","name":"created_disk"}},{"Action":{"action_name":"disk_create.regions_alloc","label":"RegionsAlloc","name":"datasets_and_regions"}},{"Action":{"action_name":"disk_create.space_account","label":"SpaceAccount","name":"no_result"}},{"Action":{"action_name":"disk_create.regions_ensure_undo","label":"RegionsEnsureUndo","name":"regions_ensure_undo"}},{"Action":{"action_name":"disk_create.regions_ensure","label":"RegionsEnsure","name":"regions_ensure"}},{"Action":{"action_name":"disk_create.create_volume_record","label":"CreateVolumeRecord","name":"created_volume"}},{"Action":{"action_name":"disk_create.finalize_disk_record","label":"FinalizeDiskRecord","name":"disk_runtime"}},{"Start":{"params":{"create_params":{"description":"","disk_source":{"block_size":512,"type":"blank"},"name":"disk-55de88b5ee4","size":1073741824},"project_id":"a7cafe05-827c-404c-8be6-d16f88bf31eb","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","silo_user_id":"d5ad8f35-a929-4fe6-9dd1-b6f886fec39e"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"disk-create","start_node":9} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
28442024-11-06T00:19:39.183ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create
28452024-11-06T00:19:39.187ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create
28462024-11-06T00:19:39.187ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
28472024-11-06T00:19:39.187ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
28482024-11-06T00:19:39.187ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
28492024-11-06T00:19:39.194ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
28502024-11-06T00:19:39.194ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
28512024-11-06T00:19:39.199ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
28522024-11-06T00:19:39.199ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
28532024-11-06T00:19:39.204ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
28542024-11-06T00:19:39.204ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf")) node_id = 0 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
28552024-11-06T00:19:39.209ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
28562024-11-06T00:19:39.209ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
28572024-11-06T00:19:39.214ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
28582024-11-06T00:19:39.214ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")) node_id = 1 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
28592024-11-06T00:19:39.217ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
28602024-11-06T00:19:39.217ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
28612024-11-06T00:19:39.221ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28622024-11-06T00:19:39.221ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28632024-11-06T00:19:39.222ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28642024-11-06T00:19:39.223ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28652024-11-06T00:19:39.224ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28662024-11-06T00:19:39.224ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28672024-11-06T00:19:39.226ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28682024-11-06T00:19:39.227ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28692024-11-06T00:19:39.229ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28702024-11-06T00:19:39.229ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28712024-11-06T00:19:39.231ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28722024-11-06T00:19:39.231ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28732024-11-06T00:19:39.234ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28742024-11-06T00:19:39.236ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ById(a7cafe05-827c-404c-8be6-d16f88bf31eb) } result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28752024-11-06T00:19:39.236ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28762024-11-06T00:19:39.236ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28772024-11-06T00:19:39.239ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28782024-11-06T00:19:39.239ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28792024-11-06T00:19:39.241ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28802024-11-06T00:19:39.241ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28812024-11-06T00:19:39.244ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28822024-11-06T00:19:39.244ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28832024-11-06T00:19:39.246ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28842024-11-06T00:19:39.248ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ById(a7cafe05-827c-404c-8be6-d16f88bf31eb) } result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28852024-11-06T00:19:39.248ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28862024-11-06T00:19:39.248ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = CreateDiskRecord
28872024-11-06T00:19:39.294ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
28882024-11-06T00:19:39.294ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf"), "name": String("disk-55de88b5ee4"), "time_created": String("2024-11-06T00:19:39.221586Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:39.221586Z")}, "pantry_address": Null, "project_id": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-11-06T00:19:39.221586Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}) node_id = 2 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
28892024-11-06T00:19:39.302ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
28902024-11-06T00:19:39.302ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
28912024-11-06T00:19:39.308ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = RegionsAlloc
28922024-11-06T00:19:39.308ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = RegionsAlloc
28932024-11-06T00:19:39.357ZINFOnexus (datastore): Allocated regions for volume datasets_and_regions = [(Dataset { identity: DatasetIdentity { id: 9e32dc68-c273-4519-b053-5b4fe091230c, time_created: 2024-11-06T00:19:32.804373Z, time_modified: 2024-11-06T00:19:32.804373Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 25d63394-e252-4651-bd2a-cb7cb7ea5b3e, ip: Some(fd00:1122:3344:101::14), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: ce2dfe53-d91c-48c8-94ba-b12c5332bc74, time_created: 2024-11-06T00:19:39.324980Z, time_modified: 2024-11-06T00:19:39.324980Z }, dataset_id: 9e32dc68-c273-4519-b053-5b4fe091230c, volume_id: d5c5b59a-f93a-4504-9c2b-2240baddd2f6, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false }), (Dataset { identity: DatasetIdentity { id: f0b30f62-cb14-417f-a5b2-f6887992fefe, time_created: 2024-11-06T00:19:32.804373Z, time_modified: 2024-11-06T00:19:32.804373Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 9a4fd05b-1fb2-49d1-ab40-b32093e6fd86, ip: Some(fd00:1122:3344:101::13), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: d6e2fd26-ebc4-48ba-98ec-259e18546cdc, time_created: 2024-11-06T00:19:39.324980Z, time_modified: 2024-11-06T00:19:39.324980Z }, dataset_id: f0b30f62-cb14-417f-a5b2-f6887992fefe, volume_id: d5c5b59a-f93a-4504-9c2b-2240baddd2f6, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false }), (Dataset { identity: DatasetIdentity { id: f18d6d96-6447-45c4-9068-2f092d9ddca6, time_created: 2024-11-06T00:19:32.804373Z, time_modified: 2024-11-06T00:19:32.804373Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: aaf2d272-1feb-4e24-ba54-7075c6ab94d1, ip: Some(fd00:1122:3344:101::15), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: bb3c241e-4f9a-47c6-99ce-4ed352bf2e42, time_created: 2024-11-06T00:19:39.324980Z, time_modified: 2024-11-06T00:19:39.324980Z }, dataset_id: f18d6d96-6447-45c4-9068-2f092d9ddca6, volume_id: d5c5b59a-f93a-4504-9c2b-2240baddd2f6, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false })] file = nexus/db-queries/src/db/datastore/region.rs:280 maybe_snapshot_id = None volume_id = d5c5b59a-f93a-4504-9c2b-2240baddd2f6
28942024-11-06T00:19:39.357ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
28952024-11-06T00:19:39.357ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Array [Object {"compression": Null, "identity": Object {"id": String("9e32dc68-c273-4519-b053-5b4fe091230c"), "time_created": String("2024-11-06T00:19:32.804373Z"), "time_modified": String("2024-11-06T00:19:32.804373Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("25d63394-e252-4651-bd2a-cb7cb7ea5b3e"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("9e32dc68-c273-4519-b053-5b4fe091230c"), "extent_count": Number(16), "identity": Object {"id": String("ce2dfe53-d91c-48c8-94ba-b12c5332bc74"), "time_created": String("2024-11-06T00:19:39.324980Z"), "time_modified": String("2024-11-06T00:19:39.324980Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}], Array [Object {"compression": Null, "identity": Object {"id": String("f0b30f62-cb14-417f-a5b2-f6887992fefe"), "time_created": String("2024-11-06T00:19:32.804373Z"), "time_modified": String("2024-11-06T00:19:32.804373Z")}, "ip": String("fd00:1122:3344:101::13"), "kind": String("Crucible"), "pool_id": String("9a4fd05b-1fb2-49d1-ab40-b32093e6fd86"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("f0b30f62-cb14-417f-a5b2-f6887992fefe"), "extent_count": Number(16), "identity": Object {"id": String("d6e2fd26-ebc4-48ba-98ec-259e18546cdc"), "time_created": String("2024-11-06T00:19:39.324980Z"), "time_modified": String("2024-11-06T00:19:39.324980Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}], Array [Object {"compression": Null, "identity": Object {"id": String("f18d6d96-6447-45c4-9068-2f092d9ddca6"), "time_created": String("2024-11-06T00:19:32.804373Z"), "time_modified": String("2024-11-06T00:19:32.804373Z")}, "ip": String("fd00:1122:3344:101::15"), "kind": String("Crucible"), "pool_id": String("aaf2d272-1feb-4e24-ba54-7075c6ab94d1"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("f18d6d96-6447-45c4-9068-2f092d9ddca6"), "extent_count": Number(16), "identity": Object {"id": String("bb3c241e-4f9a-47c6-99ce-4ed352bf2e42"), "time_created": String("2024-11-06T00:19:39.324980Z"), "time_modified": String("2024-11-06T00:19:39.324980Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}]]) node_id = 3 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
28962024-11-06T00:19:39.361ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
28972024-11-06T00:19:39.361ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
28982024-11-06T00:19:39.365ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = SpaceAccount
28992024-11-06T00:19:39.365ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = SpaceAccount
29002024-11-06T00:19:39.382ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
29012024-11-06T00:19:39.382ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
29022024-11-06T00:19:39.387ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
29032024-11-06T00:19:39.387ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
29042024-11-06T00:19:39.390ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
29052024-11-06T00:19:39.390ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
29062024-11-06T00:19:39.393ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
29072024-11-06T00:19:39.393ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
29082024-11-06T00:19:39.428ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 189.464279ms dataset = f18d6d96-6447-45c4-9068-2f092d9ddca6 file = nexus/src/app/crucible.rs:230 region = bb3c241e-4f9a-47c6-99ce-4ed352bf2e42 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create
29092024-11-06T00:19:39.438ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 203.158039ms dataset = 9e32dc68-c273-4519-b053-5b4fe091230c file = nexus/src/app/crucible.rs:230 region = ce2dfe53-d91c-48c8-94ba-b12c5332bc74 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create
29102024-11-06T00:19:39.454ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 339.164678ms dataset = f0b30f62-cb14-417f-a5b2-f6887992fefe file = nexus/src/app/crucible.rs:230 region = d6e2fd26-ebc4-48ba-98ec-259e18546cdc saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create
29112024-11-06T00:19:39.647ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 406.959004ms dataset = f18d6d96-6447-45c4-9068-2f092d9ddca6 file = nexus/src/app/crucible.rs:230 region = bb3c241e-4f9a-47c6-99ce-4ed352bf2e42 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create
29122024-11-06T00:19:39.665ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 591.406007ms dataset = 9e32dc68-c273-4519-b053-5b4fe091230c file = nexus/src/app/crucible.rs:230 region = ce2dfe53-d91c-48c8-94ba-b12c5332bc74 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create
29132024-11-06T00:19:39.799ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 699.876561ms dataset = f0b30f62-cb14-417f-a5b2-f6887992fefe file = nexus/src/app/crucible.rs:230 region = d6e2fd26-ebc4-48ba-98ec-259e18546cdc saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create
29142024-11-06T00:19:40.517ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
29152024-11-06T00:19:40.517ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf\\",\\"key\\":\\"vtFFPLSD5x8mKTnz91aFEqncFXs84094W9dz2gWckdw=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::15]:19000\\",\\"[fd00:1122:3344:101::14]:19000\\",\\"[fd00:1122:3344:101::13]:19000\\"]}}]}")) node_id = 6 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
29162024-11-06T00:19:40.521ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
29172024-11-06T00:19:40.521ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
29182024-11-06T00:19:40.542ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
29192024-11-06T00:19:40.542ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
29202024-11-06T00:19:40.547ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
29212024-11-06T00:19:40.547ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
29222024-11-06T00:19:40.551ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29232024-11-06T00:19:40.551ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29242024-11-06T00:19:40.553ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29252024-11-06T00:19:40.554ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29262024-11-06T00:19:40.555ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29272024-11-06T00:19:40.555ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29282024-11-06T00:19:40.557ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29292024-11-06T00:19:40.557ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29302024-11-06T00:19:40.562ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29312024-11-06T00:19:40.562ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29322024-11-06T00:19:40.565ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29332024-11-06T00:19:40.565ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29342024-11-06T00:19:40.568ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29352024-11-06T00:19:40.568ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29362024-11-06T00:19:40.570ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29372024-11-06T00:19:40.573ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ById(a7cafe05-827c-404c-8be6-d16f88bf31eb) }, key: d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf, lookup_type: ById(d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf) } result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29382024-11-06T00:19:40.573ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29392024-11-06T00:19:40.573ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29402024-11-06T00:19:40.575ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29412024-11-06T00:19:40.575ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29422024-11-06T00:19:40.578ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29432024-11-06T00:19:40.578ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29442024-11-06T00:19:40.581ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29452024-11-06T00:19:40.581ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29462024-11-06T00:19:40.583ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29472024-11-06T00:19:40.586ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ById(a7cafe05-827c-404c-8be6-d16f88bf31eb) }, key: d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf, lookup_type: ById(d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf) } result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29482024-11-06T00:19:40.586ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29492024-11-06T00:19:40.586ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_node = FinalizeDiskRecord
29502024-11-06T00:19:40.608ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
29512024-11-06T00:19:40.608ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
29522024-11-06T00:19:40.613ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
29532024-11-06T00:19:40.613ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
29542024-11-06T00:19:40.617ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
29552024-11-06T00:19:40.617ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
29562024-11-06T00:19:40.620ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
29572024-11-06T00:19:40.620ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
29582024-11-06T00:19:40.663ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
29592024-11-06T00:19:40.663ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a saga_name = disk-create saga_result = SagaResult { saga_id: 303eac8b-ad6a-45af-90d4-c4af71982f9a, saga_log: SagaLog { saga_id: 303eac8b-ad6a-45af-90d4-c4af71982f9a, unwinding: false, events: [N009 started, N009 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N010 started, N010 succeeded], node_status: {0: Succeeded(String("d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf")), 1: Succeeded(String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")), 2: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf"), "name": String("disk-55de88b5ee4"), "time_created": String("2024-11-06T00:19:39.221586Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:39.221586Z")}, "pantry_address": Null, "project_id": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-11-06T00:19:39.221586Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}), 3: Succeeded(Array [Array [Object {"compression": Null, "identity": Object {"id": String("9e32dc68-c273-4519-b053-5b4fe091230c"), "time_created": String("2024-11-06T00:19:32.804373Z"), "time_modified": String("2024-11-06T00:19:32.804373Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("25d63394-e252-4651-bd2a-cb7cb7ea5b3e"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("9e32dc68-c273-4519-b053-5b4fe091230c"), "extent_count": Number(16), "identity": Object {"id": String("ce2dfe53-d91c-48c8-94ba-b12c5332bc74"), "time_created": String("2024-11-06T00:19:39.324980Z"), "time_modified": String("2024-11-06T00:19:39.324980Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}], Array [Object {"compression": Null, "identity": Object {"id": String("f0b30f62-cb14-417f-a5b2-f6887992fefe"), "time_created": String("2024-11-06T00:19:32.804373Z"), "time_modified": String("2024-11-06T00:19:32.804373Z")}, "ip": String("fd00:1122:3344:101::13"), "kind": String("Crucible"), "pool_id": String("9a4fd05b-1fb2-49d1-ab40-b32093e6fd86"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("f0b30f62-cb14-417f-a5b2-f6887992fefe"), "extent_count": Number(16), "identity": Object {"id": String("d6e2fd26-ebc4-48ba-98ec-259e18546cdc"), "time_created": String("2024-11-06T00:19:39.324980Z"), "time_modified": String("2024-11-06T00:19:39.324980Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}], Array [Object {"compression": Null, "identity": Object {"id": String("f18d6d96-6447-45c4-9068-2f092d9ddca6"), "time_created": String("2024-11-06T00:19:32.804373Z"), "time_modified": String("2024-11-06T00:19:32.804373Z")}, "ip": String("fd00:1122:3344:101::15"), "kind": String("Crucible"), "pool_id": String("aaf2d272-1feb-4e24-ba54-7075c6ab94d1"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("f18d6d96-6447-45c4-9068-2f092d9ddca6"), "extent_count": Number(16), "identity": Object {"id": String("bb3c241e-4f9a-47c6-99ce-4ed352bf2e42"), "time_created": String("2024-11-06T00:19:39.324980Z"), "time_modified": String("2024-11-06T00:19:39.324980Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}]]), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf\\",\\"key\\":\\"vtFFPLSD5x8mKTnz91aFEqncFXs84094W9dz2gWckdw=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::15]:19000\\",\\"[fd00:1122:3344:101::14]:19000\\",\\"[fd00:1122:3344:101::13]:19000\\"]}}]}")), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"created_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf"), "name": String("disk-55de88b5ee4"), "time_created": String("2024-11-06T00:19:39.221586Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:39.221586Z")}, "pantry_address": Null, "project_id": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-11-06T00:19:39.221586Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}, "created_volume": Null, "datasets_and_regions": Array [Array [Object {"compression": Null, "identity": Object {"id": String("9e32dc68-c273-4519-b053-5b4fe091230c"), "time_created": String("2024-11-06T00:19:32.804373Z"), "time_modified": String("2024-11-06T00:19:32.804373Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("25d63394-e252-4651-bd2a-cb7cb7ea5b3e"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("9e32dc68-c273-4519-b053-5b4fe091230c"), "extent_count": Number(16), "identity": Object {"id": String("ce2dfe53-d91c-48c8-94ba-b12c5332bc74"), "time_created": String("2024-11-06T00:19:39.324980Z"), "time_modified": String("2024-11-06T00:19:39.324980Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}], Array [Object {"compression": Null, "identity": Object {"id": String("f0b30f62-cb14-417f-a5b2-f6887992fefe"), "time_created": String("2024-11-06T00:19:32.804373Z"), "time_modified": String("2024-11-06T00:19:32.804373Z")}, "ip": String("fd00:1122:3344:101::13"), "kind": String("Crucible"), "pool_id": String("9a4fd05b-1fb2-49d1-ab40-b32093e6fd86"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("f0b30f62-cb14-417f-a5b2-f6887992fefe"), "extent_count": Number(16), "identity": Object {"id": String("d6e2fd26-ebc4-48ba-98ec-259e18546cdc"), "time_created": String("2024-11-06T00:19:39.324980Z"), "time_modified": String("2024-11-06T00:19:39.324980Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}], Array [Object {"compression": Null, "identity": Object {"id": String("f18d6d96-6447-45c4-9068-2f092d9ddca6"), "time_created": String("2024-11-06T00:19:32.804373Z"), "time_modified": String("2024-11-06T00:19:32.804373Z")}, "ip": String("fd00:1122:3344:101::15"), "kind": String("Crucible"), "pool_id": String("aaf2d272-1feb-4e24-ba54-7075c6ab94d1"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("f18d6d96-6447-45c4-9068-2f092d9ddca6"), "extent_count": Number(16), "identity": Object {"id": String("bb3c241e-4f9a-47c6-99ce-4ed352bf2e42"), "time_created": String("2024-11-06T00:19:39.324980Z"), "time_modified": String("2024-11-06T00:19:39.324980Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}]], "disk_id": String("d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf"), "disk_runtime": Null, "no_result": Null, "regions_ensure": String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf\\",\\"key\\":\\"vtFFPLSD5x8mKTnz91aFEqncFXs84094W9dz2gWckdw=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::15]:19000\\",\\"[fd00:1122:3344:101::14]:19000\\",\\"[fd00:1122:3344:101::13]:19000\\"]}}]}"), "regions_ensure_undo": Null, "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")} }) }
29602024-11-06T00:19:40.663ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1535026 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 9674837a-75f3-4d5a-8b3b-236f30a44bcf response_code = 201 uri = /v1/disks?project=proj-93c324908ee
29612024-11-06T00:19:40.664ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29622024-11-06T00:19:40.664ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29632024-11-06T00:19:40.665ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29642024-11-06T00:19:40.666ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29652024-11-06T00:19:40.667ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29662024-11-06T00:19:40.668ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("token = \\"d27d5e9e4db716d98ec7ec234e0646949e77ad52\\"") } result = Ok(())
29672024-11-06T00:19:40.668ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29682024-11-06T00:19:40.668ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29692024-11-06T00:19:40.670ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29702024-11-06T00:19:40.670ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29712024-11-06T00:19:40.672ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29722024-11-06T00:19:40.672ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29732024-11-06T00:19:40.673ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29742024-11-06T00:19:40.673ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29752024-11-06T00:19:40.674ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29762024-11-06T00:19:40.675ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
29772024-11-06T00:19:40.675ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29782024-11-06T00:19:40.675ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29792024-11-06T00:19:40.677ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29802024-11-06T00:19:40.678ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("d27d5e9e4db716d98ec7ec234e0646949e77ad52") } result = Ok(())
29812024-11-06T00:19:40.678ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29822024-11-06T00:19:40.678ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29832024-11-06T00:19:40.686ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29842024-11-06T00:19:40.686ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29852024-11-06T00:19:40.687ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29862024-11-06T00:19:40.688ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29872024-11-06T00:19:40.689ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29882024-11-06T00:19:40.689ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29892024-11-06T00:19:40.690ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29902024-11-06T00:19:40.690ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29912024-11-06T00:19:40.691ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29922024-11-06T00:19:40.693ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
29932024-11-06T00:19:40.693ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29942024-11-06T00:19:40.693ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29952024-11-06T00:19:40.694ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29962024-11-06T00:19:40.694ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29972024-11-06T00:19:40.696ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29982024-11-06T00:19:40.696ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29992024-11-06T00:19:40.697ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30002024-11-06T00:19:40.698ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) } result = Ok(())
30012024-11-06T00:19:40.698ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 roles = RoleSet { roles: {} } uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30022024-11-06T00:19:40.699ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 resource = Database result = Ok(()) uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30032024-11-06T00:19:40.700ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 roles = RoleSet { roles: {} } uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30042024-11-06T00:19:40.700ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 resource = Database result = Ok(()) uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30052024-11-06T00:19:40.702ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 roles = RoleSet { roles: {} } uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30062024-11-06T00:19:40.702ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 resource = Database result = Ok(()) uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30072024-11-06T00:19:40.705ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 roles = RoleSet { roles: {} } uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30082024-11-06T00:19:40.706ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 resource = Database result = Ok(()) uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30092024-11-06T00:19:40.708ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 roles = RoleSet { roles: {} } uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30102024-11-06T00:19:40.708ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 resource = Database result = Ok(()) uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30112024-11-06T00:19:40.710ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 roles = RoleSet { roles: {} } uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30122024-11-06T00:19:40.710ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 resource = Database result = Ok(()) uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30132024-11-06T00:19:40.712ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 roles = RoleSet { roles: {} } uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30142024-11-06T00:19:40.712ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 resource = Database result = Ok(()) uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30152024-11-06T00:19:40.715ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30162024-11-06T00:19:40.717ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") }, key: d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf, lookup_type: ByName("disk-55de88b5ee4") } result = Ok(()) uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30172024-11-06T00:19:40.717ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 roles = RoleSet { roles: {} } uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30182024-11-06T00:19:40.717ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 resource = Database result = Ok(()) uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30192024-11-06T00:19:40.719ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 roles = RoleSet { roles: {} } uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30202024-11-06T00:19:40.720ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 resource = Database result = Ok(()) uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30212024-11-06T00:19:40.721ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 roles = RoleSet { roles: {} } uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30222024-11-06T00:19:40.721ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 resource = Database result = Ok(()) uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30232024-11-06T00:19:40.722ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 roles = RoleSet { roles: {} } uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30242024-11-06T00:19:40.722ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 resource = Database result = Ok(()) uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30252024-11-06T00:19:40.724ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 roles = RoleSet { roles: {} } uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30262024-11-06T00:19:40.724ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 resource = Database result = Ok(()) uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30272024-11-06T00:19:40.727ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 roles = RoleSet { roles: {} } uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30282024-11-06T00:19:40.727ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 resource = Database result = Ok(()) uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30292024-11-06T00:19:40.729ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 roles = RoleSet { roles: {} } uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30302024-11-06T00:19:40.729ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 resource = Database result = Ok(()) uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30312024-11-06T00:19:40.731ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30322024-11-06T00:19:40.734ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ById(a7cafe05-827c-404c-8be6-d16f88bf31eb) }, key: d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf, lookup_type: ById(d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf) } result = Ok(()) uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
30332024-11-06T00:19:40.734ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete
30342024-11-06T00:19:40.735ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[3,4,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","silo_user_id":"d5ad8f35-a929-4fe6-9dd1-b6f886fec39e"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"d5c5b59a-f93a-4504-9c2b-2240baddd2f6"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.find_freed_crucible_regions","label":"FindFreedCrucibleRegions","name":"freed_crucible_regions"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"volume_hard_deleted"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf","project_id":"a7cafe05-827c-404c-8be6-d16f88bf31eb","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","silo_user_id":"d5ad8f35-a929-4fe6-9dd1-b6f886fec39e"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"d5c5b59a-f93a-4504-9c2b-2240baddd2f6"}}},"End"]},"saga_name":"disk-delete","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30352024-11-06T00:19:40.735ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete
30362024-11-06T00:19:40.739ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete
30372024-11-06T00:19:40.739ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30382024-11-06T00:19:40.739ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30392024-11-06T00:19:40.739ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30402024-11-06T00:19:40.744ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30412024-11-06T00:19:40.744ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30422024-11-06T00:19:40.748ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30432024-11-06T00:19:40.748ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30442024-11-06T00:19:40.763ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30452024-11-06T00:19:40.763ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf"), "name": String("disk-55de88b5ee4"), "time_created": String("2024-11-06T00:19:39.221586Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:39.221586Z")}, "pantry_address": Null, "project_id": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-06T00:19:40.573181Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}) node_id = 0 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30462024-11-06T00:19:40.768ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30472024-11-06T00:19:40.768ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30482024-11-06T00:19:40.770ZDEBGnexus (SagaExecutor): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true roles = RoleSet { roles: {} } saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete saga_node = SpaceAccount
30492024-11-06T00:19:40.771ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true resource = Database result = Ok(()) saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete saga_node = SpaceAccount
30502024-11-06T00:19:40.802ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30512024-11-06T00:19:40.802ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30522024-11-06T00:19:40.806ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30532024-11-06T00:19:40.806ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30542024-11-06T00:19:40.810ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30552024-11-06T00:19:40.810ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "silo_user_id": String("d5ad8f35-a929-4fe6-9dd1-b6f886fec39e")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}) node_id = 2 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30562024-11-06T00:19:40.814ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30572024-11-06T00:19:40.814ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30582024-11-06T00:19:40.818ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30592024-11-06T00:19:40.818ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30602024-11-06T00:19:40.821ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30612024-11-06T00:19:40.821ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30622024-11-06T00:19:40.849ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30632024-11-06T00:19:40.849ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("bb3c241e-4f9a-47c6-99ce-4ed352bf2e42"), String("ce2dfe53-d91c-48c8-94ba-b12c5332bc74"), String("d6e2fd26-ebc4-48ba-98ec-259e18546cdc")]}}) node_id = 4 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30642024-11-06T00:19:40.853ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30652024-11-06T00:19:40.853ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30662024-11-06T00:19:40.857ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30672024-11-06T00:19:40.857ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30682024-11-06T00:19:40.862ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30692024-11-06T00:19:40.862ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30702024-11-06T00:19:40.896ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 51.492736ms file = nexus/src/app/crucible.rs:827 region_id = bb3c241e-4f9a-47c6-99ce-4ed352bf2e42 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete
30712024-11-06T00:19:40.897ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 75.615319ms file = nexus/src/app/crucible.rs:827 region_id = d6e2fd26-ebc4-48ba-98ec-259e18546cdc saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete
30722024-11-06T00:19:40.898ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 134.082633ms file = nexus/src/app/crucible.rs:827 region_id = ce2dfe53-d91c-48c8-94ba-b12c5332bc74 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete
30732024-11-06T00:19:40.957ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 137.327999ms file = nexus/src/app/crucible.rs:827 region_id = bb3c241e-4f9a-47c6-99ce-4ed352bf2e42 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete
30742024-11-06T00:19:40.977ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 126.635039ms file = nexus/src/app/crucible.rs:827 region_id = d6e2fd26-ebc4-48ba-98ec-259e18546cdc saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete
30752024-11-06T00:19:41.036ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = ce2dfe53-d91c-48c8-94ba-b12c5332bc74 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete
30762024-11-06T00:19:41.097ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = bb3c241e-4f9a-47c6-99ce-4ed352bf2e42 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete
30772024-11-06T00:19:41.108ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = d6e2fd26-ebc4-48ba-98ec-259e18546cdc saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete
30782024-11-06T00:19:41.131ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30792024-11-06T00:19:41.131ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30802024-11-06T00:19:41.134ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30812024-11-06T00:19:41.134ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30822024-11-06T00:19:41.140ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30832024-11-06T00:19:41.140ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30842024-11-06T00:19:41.143ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30852024-11-06T00:19:41.143ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30862024-11-06T00:19:41.147ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30872024-11-06T00:19:41.147ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30882024-11-06T00:19:41.152ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30892024-11-06T00:19:41.152ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30902024-11-06T00:19:41.160ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30912024-11-06T00:19:41.160ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array []) node_id = 9 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30922024-11-06T00:19:41.164ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30932024-11-06T00:19:41.164ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30942024-11-06T00:19:41.167ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30952024-11-06T00:19:41.167ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30962024-11-06T00:19:41.170ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
30972024-11-06T00:19:41.170ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
30982024-11-06T00:19:41.178ZINFOnexus (SagaExecutor): allocated regions for d5c5b59a-f93a-4504-9c2b-2240baddd2f6 is empty, calling volume_hard_delete file = nexus/src/app/sagas/volume_delete.rs:546 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete
30992024-11-06T00:19:41.182ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
31002024-11-06T00:19:41.182ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 11 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
31012024-11-06T00:19:41.185ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
31022024-11-06T00:19:41.185ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
31032024-11-06T00:19:41.189ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
31042024-11-06T00:19:41.189ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 12 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
31052024-11-06T00:19:41.193ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
31062024-11-06T00:19:41.193ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
31072024-11-06T00:19:41.196ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
31082024-11-06T00:19:41.196ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
31092024-11-06T00:19:41.200ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
31102024-11-06T00:19:41.200ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
31112024-11-06T00:19:41.242ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete sec_id = e2378399-e8ed-453c-847a-0a419dfd0966
31122024-11-06T00:19:41.242ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a saga_name = disk-delete saga_result = SagaResult { saga_id: 64da5b3b-c863-4e6b-b806-ba0152e4a97a, saga_log: SagaLog { saga_id: 64da5b3b-c863-4e6b-b806-ba0152e4a97a, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N006 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf"), "name": String("disk-55de88b5ee4"), "time_created": String("2024-11-06T00:19:39.221586Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:39.221586Z")}, "pantry_address": Null, "project_id": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-06T00:19:40.573181Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "silo_user_id": String("d5ad8f35-a929-4fe6-9dd1-b6f886fec39e")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("bb3c241e-4f9a-47c6-99ce-4ed352bf2e42"), String("ce2dfe53-d91c-48c8-94ba-b12c5332bc74"), String("d6e2fd26-ebc4-48ba-98ec-259e18546cdc")]}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Array []), 10: Succeeded(Null), 11: Succeeded(Bool(true)), 12: Succeeded(Bool(true)), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Bool(true), node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("bb3c241e-4f9a-47c6-99ce-4ed352bf2e42"), String("ce2dfe53-d91c-48c8-94ba-b12c5332bc74"), String("d6e2fd26-ebc4-48ba-98ec-259e18546cdc")]}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d65ba5c1-312d-4ffa-8cac-b4e4d1bd3dbf"), "name": String("disk-55de88b5ee4"), "time_created": String("2024-11-06T00:19:39.221586Z"), "time_deleted": Null, "time_modified": String("2024-11-06T00:19:39.221586Z")}, "pantry_address": Null, "project_id": String("a7cafe05-827c-404c-8be6-d16f88bf31eb"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-06T00:19:40.573181Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}, "freed_crucible_regions": Array [], "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("538efd2f-b8ed-4a95-91b1-680b63627575"), "silo_user_id": String("d5ad8f35-a929-4fe6-9dd1-b6f886fec39e")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("d5c5b59a-f93a-4504-9c2b-2240baddd2f6")}, "volume_delete_subsaga_no_result": Bool(true), "volume_hard_deleted": Bool(true)} }) }
31132024-11-06T00:19:41.242ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 578265 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = e16fc273-816d-4aa7-8ed0-d8d4443eb314 response_code = 204 uri = /v1/disks/disk-55de88b5ee4?project=proj-93c324908ee
31142024-11-06T00:19:41.244ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31152024-11-06T00:19:41.244ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31162024-11-06T00:19:41.246ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31172024-11-06T00:19:41.248ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = DeviceAuthRequestList result = Ok(())
31182024-11-06T00:19:41.248ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31192024-11-06T00:19:41.248ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31202024-11-06T00:19:41.254ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10481 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 49333701-0936-4502-8748-0b73cc143528 response_code = 200 uri = /device/auth
31212024-11-06T00:19:41.255ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31222024-11-06T00:19:41.255ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31232024-11-06T00:19:41.257ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31242024-11-06T00:19:41.258ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31252024-11-06T00:19:41.259ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31262024-11-06T00:19:41.260ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("token = \\"d27d5e9e4db716d98ec7ec234e0646949e77ad52\\"") } result = Ok(())
31272024-11-06T00:19:41.260ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31282024-11-06T00:19:41.260ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31292024-11-06T00:19:41.262ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31302024-11-06T00:19:41.262ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31312024-11-06T00:19:41.263ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31322024-11-06T00:19:41.264ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31332024-11-06T00:19:41.265ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31342024-11-06T00:19:41.265ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31352024-11-06T00:19:41.266ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31362024-11-06T00:19:41.268ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
31372024-11-06T00:19:41.268ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31382024-11-06T00:19:41.268ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31392024-11-06T00:19:41.269ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31402024-11-06T00:19:41.270ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("d27d5e9e4db716d98ec7ec234e0646949e77ad52") } result = Ok(())
31412024-11-06T00:19:41.270ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31422024-11-06T00:19:41.271ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31432024-11-06T00:19:41.277ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31442024-11-06T00:19:41.277ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31452024-11-06T00:19:41.278ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31462024-11-06T00:19:41.278ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31472024-11-06T00:19:41.280ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31482024-11-06T00:19:41.280ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31492024-11-06T00:19:41.281ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31502024-11-06T00:19:41.282ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31512024-11-06T00:19:41.283ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31522024-11-06T00:19:41.284ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
31532024-11-06T00:19:41.284ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31542024-11-06T00:19:41.284ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31552024-11-06T00:19:41.286ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31562024-11-06T00:19:41.286ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31572024-11-06T00:19:41.287ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31582024-11-06T00:19:41.288ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31592024-11-06T00:19:41.289ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31602024-11-06T00:19:41.290ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) } result = Ok(())
31612024-11-06T00:19:41.290ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {} } uri = /device/confirm
31622024-11-06T00:19:41.290ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = Database result = Ok(()) uri = /device/confirm
31632024-11-06T00:19:41.298ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {} } uri = /device/confirm
31642024-11-06T00:19:41.298ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = Database result = Ok(()) uri = /device/confirm
31652024-11-06T00:19:41.301ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {} } uri = /device/confirm
31662024-11-06T00:19:41.301ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = Database result = Ok(()) uri = /device/confirm
31672024-11-06T00:19:41.305ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /device/confirm
31682024-11-06T00:19:41.306ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = DeviceAuthRequest { parent: Fleet, key: "LDNQ-SFQW", lookup_type: ByCompositeId("user_code = \\"LDNQ-SFQW\\"") } result = Ok(()) uri = /device/confirm
31692024-11-06T00:19:41.306ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {} } uri = /device/confirm
31702024-11-06T00:19:41.306ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = Database result = Ok(()) uri = /device/confirm
31712024-11-06T00:19:41.307ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {} } uri = /device/confirm
31722024-11-06T00:19:41.308ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = Database result = Ok(()) uri = /device/confirm
31732024-11-06T00:19:41.309ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {} } uri = /device/confirm
31742024-11-06T00:19:41.309ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = Database result = Ok(()) uri = /device/confirm
31752024-11-06T00:19:41.312ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {} } uri = /device/confirm
31762024-11-06T00:19:41.312ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = Database result = Ok(()) uri = /device/confirm
31772024-11-06T00:19:41.315ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {} } uri = /device/confirm
31782024-11-06T00:19:41.315ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = Database result = Ok(()) uri = /device/confirm
31792024-11-06T00:19:41.317ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /device/confirm
31802024-11-06T00:19:41.318ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(()) uri = /device/confirm
31812024-11-06T00:19:41.318ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {} } uri = /device/confirm
31822024-11-06T00:19:41.318ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = Database result = Ok(()) uri = /device/confirm
31832024-11-06T00:19:41.321ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {} } uri = /device/confirm
31842024-11-06T00:19:41.321ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = Database result = Ok(()) uri = /device/confirm
31852024-11-06T00:19:41.323ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /device/confirm
31862024-11-06T00:19:41.324ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = DeviceAuthRequest { parent: Fleet, key: "LDNQ-SFQW", lookup_type: ByCompositeId("user_code = \\"LDNQ-SFQW\\"") } result = Ok(()) uri = /device/confirm
31872024-11-06T00:19:41.324ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {} } uri = /device/confirm
31882024-11-06T00:19:41.324ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = Database result = Ok(()) uri = /device/confirm
31892024-11-06T00:19:41.326ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {} } uri = /device/confirm
31902024-11-06T00:19:41.326ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = Database result = Ok(()) uri = /device/confirm
31912024-11-06T00:19:41.329ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {} } uri = /device/confirm
31922024-11-06T00:19:41.329ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = Database result = Ok(()) uri = /device/confirm
31932024-11-06T00:19:41.331ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /device/confirm
31942024-11-06T00:19:41.332ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(()) uri = /device/confirm
31952024-11-06T00:19:41.332ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d roles = RoleSet { roles: {} } uri = /device/confirm
31962024-11-06T00:19:41.332ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d resource = Database result = Ok(()) uri = /device/confirm
31972024-11-06T00:19:41.357ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102601 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = d11e3011-ac15-4e9a-a61d-dab92c01fe8d response_code = 204 uri = /device/confirm
31982024-11-06T00:19:41.359ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31992024-11-06T00:19:41.359ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32002024-11-06T00:19:41.362ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3494 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:49136 req_id = 4d71faa6-cb67-4b17-bcf1-c00efc934c16 response_code = 200 uri = /device/token
32012024-11-06T00:19:41.364ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32022024-11-06T00:19:41.364ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32032024-11-06T00:19:41.365ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32042024-11-06T00:19:41.366ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32052024-11-06T00:19:41.367ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32062024-11-06T00:19:41.368ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("token = \\"d27d5e9e4db716d98ec7ec234e0646949e77ad52\\"") } result = Ok(())
32072024-11-06T00:19:41.368ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32082024-11-06T00:19:41.369ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32092024-11-06T00:19:41.370ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32102024-11-06T00:19:41.370ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32112024-11-06T00:19:41.371ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32122024-11-06T00:19:41.371ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32132024-11-06T00:19:41.373ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32142024-11-06T00:19:41.373ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32152024-11-06T00:19:41.374ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32162024-11-06T00:19:41.376ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
32172024-11-06T00:19:41.376ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32182024-11-06T00:19:41.376ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32192024-11-06T00:19:41.377ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32202024-11-06T00:19:41.379ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("d27d5e9e4db716d98ec7ec234e0646949e77ad52") } result = Ok(())
32212024-11-06T00:19:41.379ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32222024-11-06T00:19:41.379ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32232024-11-06T00:19:41.383ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32242024-11-06T00:19:41.383ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32252024-11-06T00:19:41.384ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32262024-11-06T00:19:41.384ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32272024-11-06T00:19:41.386ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32282024-11-06T00:19:41.386ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32292024-11-06T00:19:41.388ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32302024-11-06T00:19:41.388ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32312024-11-06T00:19:41.389ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32322024-11-06T00:19:41.390ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
32332024-11-06T00:19:41.390ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32342024-11-06T00:19:41.391ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32352024-11-06T00:19:41.392ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32362024-11-06T00:19:41.392ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32372024-11-06T00:19:41.393ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32382024-11-06T00:19:41.393ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32392024-11-06T00:19:41.394ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32402024-11-06T00:19:41.396ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) } result = Ok(())
32412024-11-06T00:19:41.396ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32422024-11-06T00:19:41.396ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32432024-11-06T00:19:41.397ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32442024-11-06T00:19:41.398ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32452024-11-06T00:19:41.400ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32462024-11-06T00:19:41.400ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32472024-11-06T00:19:41.402ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32482024-11-06T00:19:41.402ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32492024-11-06T00:19:41.403ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32502024-11-06T00:19:41.404ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32512024-11-06T00:19:41.406ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32522024-11-06T00:19:41.406ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32532024-11-06T00:19:41.408ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32542024-11-06T00:19:41.408ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32552024-11-06T00:19:41.411ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32562024-11-06T00:19:41.411ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32572024-11-06T00:19:41.413ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32582024-11-06T00:19:41.416ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") }, key: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, lookup_type: ByName("default") }, key: e79fdd3f-d6d9-4429-b9c6-0de0d0028da5, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32592024-11-06T00:19:41.416ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32602024-11-06T00:19:41.416ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32612024-11-06T00:19:41.418ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32622024-11-06T00:19:41.419ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32632024-11-06T00:19:41.421ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32642024-11-06T00:19:41.421ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32652024-11-06T00:19:41.423ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32662024-11-06T00:19:41.423ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32672024-11-06T00:19:41.426ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32682024-11-06T00:19:41.429ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") }, key: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, lookup_type: ByName("default") }, key: e79fdd3f-d6d9-4429-b9c6-0de0d0028da5, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32692024-11-06T00:19:41.429ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32702024-11-06T00:19:41.429ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32712024-11-06T00:19:41.431ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32722024-11-06T00:19:41.431ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32732024-11-06T00:19:41.438ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32742024-11-06T00:19:41.438ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32752024-11-06T00:19:41.448ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32762024-11-06T00:19:41.449ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32772024-11-06T00:19:41.456ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Signaled
32782024-11-06T00:19:41.456ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92313 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 95a04331-cd83-472f-b4cc-d2d7f6e4d3ac response_code = 204 uri = /v1/vpc-subnets/default?project=proj-93c324908ee&vpc=default
32792024-11-06T00:19:41.456ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32802024-11-06T00:19:41.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32812024-11-06T00:19:41.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32822024-11-06T00:19:41.458ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32832024-11-06T00:19:41.458ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32842024-11-06T00:19:41.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32852024-11-06T00:19:41.459ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32862024-11-06T00:19:41.459ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32872024-11-06T00:19:41.460ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32882024-11-06T00:19:41.460ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32892024-11-06T00:19:41.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32902024-11-06T00:19:41.461ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32912024-11-06T00:19:41.461ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32922024-11-06T00:19:41.462ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("token = \\"d27d5e9e4db716d98ec7ec234e0646949e77ad52\\"") } result = Ok(())
32932024-11-06T00:19:41.462ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32942024-11-06T00:19:41.462ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32952024-11-06T00:19:41.463ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32962024-11-06T00:19:41.463ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32972024-11-06T00:19:41.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32982024-11-06T00:19:41.464ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32992024-11-06T00:19:41.464ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33002024-11-06T00:19:41.465ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33012024-11-06T00:19:41.465ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33022024-11-06T00:19:41.467ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33032024-11-06T00:19:41.467ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33042024-11-06T00:19:41.468ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33052024-11-06T00:19:41.469ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
33062024-11-06T00:19:41.469ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33072024-11-06T00:19:41.469ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33082024-11-06T00:19:41.471ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33092024-11-06T00:19:41.472ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("d27d5e9e4db716d98ec7ec234e0646949e77ad52") } result = Ok(())
33102024-11-06T00:19:41.472ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33112024-11-06T00:19:41.472ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33122024-11-06T00:19:41.477ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33132024-11-06T00:19:41.477ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33142024-11-06T00:19:41.478ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33152024-11-06T00:19:41.478ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33162024-11-06T00:19:41.480ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33172024-11-06T00:19:41.480ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33182024-11-06T00:19:41.481ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33192024-11-06T00:19:41.481ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33202024-11-06T00:19:41.483ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33212024-11-06T00:19:41.484ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
33222024-11-06T00:19:41.484ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33232024-11-06T00:19:41.484ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33242024-11-06T00:19:41.485ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33252024-11-06T00:19:41.486ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33262024-11-06T00:19:41.487ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33272024-11-06T00:19:41.487ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33282024-11-06T00:19:41.488ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33292024-11-06T00:19:41.489ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) } result = Ok(())
33302024-11-06T00:19:41.489ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33312024-11-06T00:19:41.489ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33322024-11-06T00:19:41.491ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33332024-11-06T00:19:41.491ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33342024-11-06T00:19:41.493ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33352024-11-06T00:19:41.493ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33362024-11-06T00:19:41.495ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33372024-11-06T00:19:41.495ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33382024-11-06T00:19:41.497ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33392024-11-06T00:19:41.497ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33402024-11-06T00:19:41.504ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33412024-11-06T00:19:41.504ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33422024-11-06T00:19:41.507ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33432024-11-06T00:19:41.507ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33442024-11-06T00:19:41.509ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/vpcs/default?project=proj-93c324908ee
33452024-11-06T00:19:41.513ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") }, key: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33462024-11-06T00:19:41.513ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33472024-11-06T00:19:41.513ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33482024-11-06T00:19:41.525ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
33492024-11-06T00:19:41.525ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33502024-11-06T00:19:41.526ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9dd64d8-e168-4a0d-bd49-02d9333cb93b", "content-length": "312", "date": "Wed, 06 Nov 2024 00:19:41 GMT"} })
33512024-11-06T00:19:41.526ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33522024-11-06T00:19:41.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33532024-11-06T00:19:41.561ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33542024-11-06T00:19:41.561ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33552024-11-06T00:19:41.564ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33562024-11-06T00:19:41.564ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33572024-11-06T00:19:41.567ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33582024-11-06T00:19:41.567ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33592024-11-06T00:19:41.570ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/vpcs/default?project=proj-93c324908ee
33602024-11-06T00:19:41.573ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") }, key: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33612024-11-06T00:19:41.573ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33622024-11-06T00:19:41.573ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33632024-11-06T00:19:41.575ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33642024-11-06T00:19:41.575ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33652024-11-06T00:19:41.581ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33662024-11-06T00:19:41.581ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33672024-11-06T00:19:41.584ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33682024-11-06T00:19:41.584ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33692024-11-06T00:19:41.590ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33702024-11-06T00:19:41.590ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33712024-11-06T00:19:41.594ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33722024-11-06T00:19:41.594ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33732024-11-06T00:19:41.597ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/vpcs/default?project=proj-93c324908ee
33742024-11-06T00:19:41.601ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") }, key: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, lookup_type: ByName("default") }, key: 3fa07511-3298-4f26-ac83-e55e431c18f1, lookup_type: ById(3fa07511-3298-4f26-ac83-e55e431c18f1) } result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33752024-11-06T00:19:41.601ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33762024-11-06T00:19:41.601ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33772024-11-06T00:19:41.606ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
33782024-11-06T00:19:41.606ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
33792024-11-06T00:19:41.606ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c1a8da01-e72c-4c80-8b6c-262e45a7bcad", "date": "Wed, 06 Nov 2024 00:19:41 GMT"} })
33802024-11-06T00:19:41.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33812024-11-06T00:19:41.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33822024-11-06T00:19:41.607ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33832024-11-06T00:19:41.607ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33842024-11-06T00:19:41.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33852024-11-06T00:19:41.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33862024-11-06T00:19:41.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33872024-11-06T00:19:41.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33882024-11-06T00:19:41.614ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33892024-11-06T00:19:41.614ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33902024-11-06T00:19:41.617ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33912024-11-06T00:19:41.617ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33922024-11-06T00:19:41.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33932024-11-06T00:19:41.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33942024-11-06T00:19:41.620ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33952024-11-06T00:19:41.620ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
33962024-11-06T00:19:41.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33972024-11-06T00:19:41.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33982024-11-06T00:19:41.622ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
33992024-11-06T00:19:41.623ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
34002024-11-06T00:19:41.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34012024-11-06T00:19:41.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34022024-11-06T00:19:41.625ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34032024-11-06T00:19:41.625ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
34042024-11-06T00:19:41.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34052024-11-06T00:19:41.625ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
34062024-11-06T00:19:41.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34072024-11-06T00:19:41.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34082024-11-06T00:19:41.628ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/vpcs/default?project=proj-93c324908ee
34092024-11-06T00:19:41.628ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34102024-11-06T00:19:41.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34112024-11-06T00:19:41.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34122024-11-06T00:19:41.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34132024-11-06T00:19:41.631ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") }, key: 40fab85c-69ed-4f58-b3fd-2c6c03bdc0da, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
34142024-11-06T00:19:41.631ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-93c324908ee
34152024-11-06T00:19:41.631ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-93c324908ee
34162024-11-06T00:19:41.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34172024-11-06T00:19:41.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
34182024-11-06T00:19:41.635ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34192024-11-06T00:19:41.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34202024-11-06T00:19:41.637ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34212024-11-06T00:19:41.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34222024-11-06T00:19:41.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34232024-11-06T00:19:41.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34242024-11-06T00:19:41.639ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181630 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 06f0be2a-82ec-4906-8dfc-d55effd0645b response_code = 204 uri = /v1/vpcs/default?project=proj-93c324908ee
34252024-11-06T00:19:41.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34262024-11-06T00:19:41.641ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34272024-11-06T00:19:41.641ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34282024-11-06T00:19:41.642ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34292024-11-06T00:19:41.642ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34302024-11-06T00:19:41.643ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
34312024-11-06T00:19:41.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34322024-11-06T00:19:41.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34332024-11-06T00:19:41.644ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34342024-11-06T00:19:41.645ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("token = \\"d27d5e9e4db716d98ec7ec234e0646949e77ad52\\"") } result = Ok(())
34352024-11-06T00:19:41.645ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34362024-11-06T00:19:41.645ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34372024-11-06T00:19:41.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34382024-11-06T00:19:41.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34392024-11-06T00:19:41.646ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34402024-11-06T00:19:41.647ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34412024-11-06T00:19:41.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34422024-11-06T00:19:41.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34432024-11-06T00:19:41.648ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34442024-11-06T00:19:41.648ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34452024-11-06T00:19:41.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34462024-11-06T00:19:41.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34472024-11-06T00:19:41.650ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34482024-11-06T00:19:41.650ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34492024-11-06T00:19:41.650ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34502024-11-06T00:19:41.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34512024-11-06T00:19:41.651ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34522024-11-06T00:19:41.652ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34532024-11-06T00:19:41.652ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
34542024-11-06T00:19:41.652ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34552024-11-06T00:19:41.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34562024-11-06T00:19:41.652ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34572024-11-06T00:19:41.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34582024-11-06T00:19:41.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34592024-11-06T00:19:41.654ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34602024-11-06T00:19:41.655ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "d27d5e9e4db716d98ec7ec234e0646949e77ad52", lookup_type: ByCompositeId("d27d5e9e4db716d98ec7ec234e0646949e77ad52") } result = Ok(())
34612024-11-06T00:19:41.655ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34622024-11-06T00:19:41.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34632024-11-06T00:19:41.655ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34642024-11-06T00:19:41.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34652024-11-06T00:19:41.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34662024-11-06T00:19:41.659ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34672024-11-06T00:19:41.659ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34682024-11-06T00:19:41.660ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34692024-11-06T00:19:41.660ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34702024-11-06T00:19:41.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
34712024-11-06T00:19:41.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34722024-11-06T00:19:41.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34732024-11-06T00:19:41.661ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34742024-11-06T00:19:41.662ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34752024-11-06T00:19:41.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34762024-11-06T00:19:41.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34772024-11-06T00:19:41.663ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34782024-11-06T00:19:41.663ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34792024-11-06T00:19:41.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34802024-11-06T00:19:41.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34812024-11-06T00:19:41.664ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34822024-11-06T00:19:41.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34832024-11-06T00:19:41.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34842024-11-06T00:19:41.666ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, lookup_type: ById(d5ad8f35-a929-4fe6-9dd1-b6f886fec39e) } result = Ok(())
34852024-11-06T00:19:41.666ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34862024-11-06T00:19:41.666ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34872024-11-06T00:19:41.667ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34882024-11-06T00:19:41.667ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34892024-11-06T00:19:41.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34902024-11-06T00:19:41.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34912024-11-06T00:19:41.668ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34922024-11-06T00:19:41.669ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34932024-11-06T00:19:41.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34942024-11-06T00:19:41.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34952024-11-06T00:19:41.673ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34962024-11-06T00:19:41.673ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34972024-11-06T00:19:41.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34982024-11-06T00:19:41.674ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34992024-11-06T00:19:41.674ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) } result = Ok(())
35002024-11-06T00:19:41.674ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35012024-11-06T00:19:41.674ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35022024-11-06T00:19:41.676ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35032024-11-06T00:19:41.676ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35042024-11-06T00:19:41.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ByName("boundary-ntp") } result = Ok(())
35052024-11-06T00:19:41.678ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35062024-11-06T00:19:41.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35072024-11-06T00:19:41.678ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35082024-11-06T00:19:41.678ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35092024-11-06T00:19:41.680ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35102024-11-06T00:19:41.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35112024-11-06T00:19:41.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35122024-11-06T00:19:41.681ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35132024-11-06T00:19:41.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35142024-11-06T00:19:41.681ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35152024-11-06T00:19:41.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35162024-11-06T00:19:41.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35172024-11-06T00:19:41.684ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35182024-11-06T00:19:41.684ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35192024-11-06T00:19:41.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35202024-11-06T00:19:41.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35212024-11-06T00:19:41.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35222024-11-06T00:19:41.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35232024-11-06T00:19:41.686ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35242024-11-06T00:19:41.686ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35252024-11-06T00:19:41.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35262024-11-06T00:19:41.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35272024-11-06T00:19:41.689ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/projects/proj-93c324908ee
35282024-11-06T00:19:41.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35292024-11-06T00:19:41.691ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") } result = Ok(()) uri = /v1/projects/proj-93c324908ee
35302024-11-06T00:19:41.691ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35312024-11-06T00:19:41.691ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35322024-11-06T00:19:41.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
35332024-11-06T00:19:41.693ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35342024-11-06T00:19:41.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35352024-11-06T00:19:41.694ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35362024-11-06T00:19:41.694ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35372024-11-06T00:19:41.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35382024-11-06T00:19:41.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35392024-11-06T00:19:41.695ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35402024-11-06T00:19:41.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35412024-11-06T00:19:41.696ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35422024-11-06T00:19:41.696ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35432024-11-06T00:19:41.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35442024-11-06T00:19:41.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35452024-11-06T00:19:41.699ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35462024-11-06T00:19:41.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35472024-11-06T00:19:41.699ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35482024-11-06T00:19:41.699ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35492024-11-06T00:19:41.700ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35502024-11-06T00:19:41.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35512024-11-06T00:19:41.701ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {(Silo, 538efd2f-b8ed-4a95-91b1-680b63627575, "admin")} } uri = /v1/projects/proj-93c324908ee
35522024-11-06T00:19:41.701ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35532024-11-06T00:19:41.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35542024-11-06T00:19:41.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35552024-11-06T00:19:41.703ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: a7cafe05-827c-404c-8be6-d16f88bf31eb, lookup_type: ByName("proj-93c324908ee") } result = Ok(()) uri = /v1/projects/proj-93c324908ee
35562024-11-06T00:19:41.703ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35572024-11-06T00:19:41.704ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35582024-11-06T00:19:41.705ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35592024-11-06T00:19:41.705ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35602024-11-06T00:19:41.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000002, lookup_type: ByName("default") } result = Ok(())
35612024-11-06T00:19:41.706ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35622024-11-06T00:19:41.707ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35632024-11-06T00:19:41.707ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35642024-11-06T00:19:41.709ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4635996c-9876-4a6f-b8b3-1fd2bddd14da", "date": "Wed, 06 Nov 2024 00:19:41 GMT"} })
35652024-11-06T00:19:41.710ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 253.383762ms iteration = 2 status = {}
35662024-11-06T00:19:41.716ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35672024-11-06T00:19:41.716ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35682024-11-06T00:19:41.734ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35692024-11-06T00:19:41.734ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35702024-11-06T00:19:41.742ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35712024-11-06T00:19:41.742ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35722024-11-06T00:19:41.743ZDEBGnexus (dropshot_external): roles actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 roles = RoleSet { roles: {} } uri = /v1/projects/proj-93c324908ee
35732024-11-06T00:19:41.744ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: d5ad8f35-a929-4fe6-9dd1-b6f886fec39e, silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, .. }) actor_id = d5ad8f35-a929-4fe6-9dd1-b6f886fec39e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 resource = Database result = Ok(()) uri = /v1/projects/proj-93c324908ee
35742024-11-06T00:19:41.753ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112477 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:49136 req_id = 610d8f4d-cf3d-43b6-9adc-84afe8abbaf4 response_code = 204 uri = /v1/projects/proj-93c324908ee
35752024-11-06T00:19:45.808ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
35762024-11-06T00:19:45.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35772024-11-06T00:19:45.808ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
35782024-11-06T00:19:45.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35792024-11-06T00:19:45.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35802024-11-06T00:19:45.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35812024-11-06T00:19:45.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35822024-11-06T00:19:45.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35832024-11-06T00:19:45.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35842024-11-06T00:19:45.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35852024-11-06T00:19:45.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35862024-11-06T00:19:45.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35872024-11-06T00:19:45.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35882024-11-06T00:19:45.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
35892024-11-06T00:19:45.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35902024-11-06T00:19:45.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35912024-11-06T00:19:45.836ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35922024-11-06T00:19:45.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35932024-11-06T00:19:45.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.132255ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35942024-11-06T00:19:45.907ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
35952024-11-06T00:19:45.907ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.029571ms iteration = 3 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
35962024-11-06T00:19:46.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1231 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 7b15e85d-68f2-4003-ab50-cc15bc4817a5 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
35972024-11-06T00:19:48.558ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:51520
35982024-11-06T00:19:48.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51520 req_id = 7319f565-22c1-41f7-bf03-6cae446b4b55 roles = RoleSet { roles: {} } uri = /metrics/producers
35992024-11-06T00:19:48.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51520 req_id = 7319f565-22c1-41f7-bf03-6cae446b4b55 resource = Database result = Ok(()) uri = /metrics/producers
36002024-11-06T00:19:48.612ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = 57aed6c0-b7d9-4021-84f4-804ca56d1b7a
36012024-11-06T00:19:48.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52537 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51520 req_id = 7319f565-22c1-41f7-bf03-6cae446b4b55 response_code = 201 uri = /metrics/producers
36022024-11-06T00:19:51.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33037 req_id = 8bbe3596-7813-4719-af71-1800738244cf roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
36032024-11-06T00:19:51.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33037 req_id = 8bbe3596-7813-4719-af71-1800738244cf resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
36042024-11-06T00:19:51.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33037 req_id = 8bbe3596-7813-4719-af71-1800738244cf response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
36052024-11-06T00:19:51.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33037 req_id = 5f0fcf2d-8335-41c7-92be-a32919c85a8a roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjM3ODM5OS1lOGVkLTQ1M2MtODQ3YS0wYTQxOWRmZDA5NjYifX0%3D
36062024-11-06T00:19:51.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33037 req_id = 5f0fcf2d-8335-41c7-92be-a32919c85a8a resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjM3ODM5OS1lOGVkLTQ1M2MtODQ3YS0wYTQxOWRmZDA5NjYifX0%3D
36072024-11-06T00:19:51.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33037 req_id = 5f0fcf2d-8335-41c7-92be-a32919c85a8a response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjM3ODM5OS1lOGVkLTQ1M2MtODQ3YS0wYTQxOWRmZDA5NjYifX0%3D
36082024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
36092024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36102024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
36112024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
36122024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 12.32\u{b5}s iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
36132024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36142024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
36152024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.869\u{b5}s iteration = 2 status = {"errors":[],"records_set_to_done":[]}
36162024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
36172024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
36182024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.91\u{b5}s iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
36192024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
36202024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36212024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
36222024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.26\u{b5}s iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36232024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
36242024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36252024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36262024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36272024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
36282024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
36292024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36302024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36312024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
36322024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36332024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
36342024-11-06T00:19:55.807ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
36352024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
36362024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36372024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36382024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
36392024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36402024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
36412024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
36422024-11-06T00:19:55.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36432024-11-06T00:19:55.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36442024-11-06T00:19:55.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36452024-11-06T00:19:55.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36462024-11-06T00:19:55.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36472024-11-06T00:19:55.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36482024-11-06T00:19:55.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36492024-11-06T00:19:55.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36502024-11-06T00:19:55.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36512024-11-06T00:19:55.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36522024-11-06T00:19:55.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36532024-11-06T00:19:55.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36542024-11-06T00:19:55.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36552024-11-06T00:19:55.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36562024-11-06T00:19:55.811ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.402401ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36572024-11-06T00:19:55.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36582024-11-06T00:19:55.812ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36592024-11-06T00:19:55.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36602024-11-06T00:19:55.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36612024-11-06T00:19:55.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36622024-11-06T00:19:55.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36632024-11-06T00:19:55.814ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36642024-11-06T00:19:55.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36652024-11-06T00:19:55.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36662024-11-06T00:19:55.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36672024-11-06T00:19:55.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36682024-11-06T00:19:55.815ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1059, tv_nsec: 153231224 } })
36692024-11-06T00:19:55.815ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
36702024-11-06T00:19:55.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36712024-11-06T00:19:55.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36722024-11-06T00:19:55.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36732024-11-06T00:19:55.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36742024-11-06T00:19:55.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36752024-11-06T00:19:55.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36762024-11-06T00:19:55.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36772024-11-06T00:19:55.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36782024-11-06T00:19:55.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36792024-11-06T00:19:55.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36802024-11-06T00:19:55.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36812024-11-06T00:19:55.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36822024-11-06T00:19:55.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36832024-11-06T00:19:55.824ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36842024-11-06T00:19:55.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36852024-11-06T00:19:55.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36862024-11-06T00:19:55.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36872024-11-06T00:19:55.825ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1059, tv_nsec: 163442617 } })
36882024-11-06T00:19:55.825ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
36892024-11-06T00:19:55.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36902024-11-06T00:19:55.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36912024-11-06T00:19:55.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
36922024-11-06T00:19:55.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36932024-11-06T00:19:55.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36942024-11-06T00:19:55.848ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
36952024-11-06T00:19:55.848ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.706379ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
36962024-11-06T00:19:55.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36972024-11-06T00:19:55.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36982024-11-06T00:19:55.850ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36992024-11-06T00:19:55.850ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
37002024-11-06T00:19:55.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37012024-11-06T00:19:55.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37022024-11-06T00:19:55.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37032024-11-06T00:19:55.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37042024-11-06T00:19:55.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37052024-11-06T00:19:55.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37062024-11-06T00:19:55.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37072024-11-06T00:19:55.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37082024-11-06T00:19:55.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37092024-11-06T00:19:55.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37102024-11-06T00:19:55.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37112024-11-06T00:19:55.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37122024-11-06T00:19:55.869ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37132024-11-06T00:19:55.869ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.824236ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37142024-11-06T00:19:55.871ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37152024-11-06T00:19:55.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37162024-11-06T00:19:55.880ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
37172024-11-06T00:19:55.880ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37182024-11-06T00:19:55.880ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c2df68f-7fac-4621-befc-c8e1ba0898d3", "content-length": "26", "date": "Wed, 06 Nov 2024 00:19:55 GMT"} })
37192024-11-06T00:19:55.880ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37202024-11-06T00:19:55.882ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37212024-11-06T00:19:55.910ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
37222024-11-06T00:19:55.910ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37232024-11-06T00:19:55.910ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db868280-72fa-4799-8d17-03f24ef4b3db", "content-length": "26", "date": "Wed, 06 Nov 2024 00:19:55 GMT"} })
37242024-11-06T00:19:55.910ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37252024-11-06T00:19:55.912ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37262024-11-06T00:19:55.916ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37272024-11-06T00:19:55.916ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37282024-11-06T00:19:55.916ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "364ff9da-3415-4986-82b2-18be17c8628c", "content-length": "372", "date": "Wed, 06 Nov 2024 00:19:55 GMT"} })
37292024-11-06T00:19:55.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37302024-11-06T00:19:55.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37312024-11-06T00:19:55.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37322024-11-06T00:19:55.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37332024-11-06T00:19:55.921ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1059, tv_nsec: 259395136 } })
37342024-11-06T00:19:55.921ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
37352024-11-06T00:19:55.922ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37362024-11-06T00:19:55.922ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37372024-11-06T00:19:55.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37382024-11-06T00:19:55.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
37392024-11-06T00:19:55.925ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37402024-11-06T00:19:55.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37412024-11-06T00:19:55.928ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 120.324592ms iteration = 2 status = 0
37422024-11-06T00:19:55.952ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 145.018785ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37432024-11-06T00:19:55.954ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37442024-11-06T00:19:55.954ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37452024-11-06T00:19:55.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37462024-11-06T00:19:55.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37472024-11-06T00:19:55.956ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 148.528639ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37482024-11-06T00:19:55.976ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37492024-11-06T00:19:55.977ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "16e075c1-e475-4a2a-b726-5bbb018bcc7a", "content-length": "1", "date": "Wed, 06 Nov 2024 00:19:55 GMT"} })
37502024-11-06T00:19:55.978ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37512024-11-06T00:19:55.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37522024-11-06T00:19:55.983ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
37532024-11-06T00:19:55.983ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37542024-11-06T00:19:55.983ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1832f357-4b56-4069-8167-58215d1111d3", "date": "Wed, 06 Nov 2024 00:19:55 GMT"} })
37552024-11-06T00:19:55.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37562024-11-06T00:19:55.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37572024-11-06T00:19:55.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37582024-11-06T00:19:55.986ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 178.980584ms iteration = 2 status = null
37592024-11-06T00:19:55.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37602024-11-06T00:19:55.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37612024-11-06T00:19:55.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37622024-11-06T00:19:55.996ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37632024-11-06T00:19:55.996ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37642024-11-06T00:19:55.998ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37652024-11-06T00:19:55.998ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37662024-11-06T00:19:55.998ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 190.62325ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37672024-11-06T00:19:55.998ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 190.941869ms iteration = 2 status = {}
37682024-11-06T00:19:56.002ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
37692024-11-06T00:19:56.002ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37702024-11-06T00:19:56.002ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7ead14e-bdc5-4b93-8f2e-515ebbf4f89a", "content-length": "26", "date": "Wed, 06 Nov 2024 00:19:55 GMT"} })
37712024-11-06T00:19:56.002ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37722024-11-06T00:19:56.003ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
37732024-11-06T00:19:56.043ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 235.328167ms iteration = 4 status = {"physical_disks_added":0}
37742024-11-06T00:19:56.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37752024-11-06T00:19:56.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37762024-11-06T00:19:56.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37772024-11-06T00:19:56.047ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37782024-11-06T00:19:56.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37792024-11-06T00:19:56.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37802024-11-06T00:19:56.049ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37812024-11-06T00:19:56.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37822024-11-06T00:19:56.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37832024-11-06T00:19:56.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37842024-11-06T00:19:56.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37852024-11-06T00:19:56.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37862024-11-06T00:19:56.096ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dd6d2597-bc0b-4d12-8350-b496bf1e67da", "date": "Wed, 06 Nov 2024 00:19:55 GMT"} })
37872024-11-06T00:19:56.098ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 290.591267ms iteration = 3 status = {}
37882024-11-06T00:19:56.111ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
37892024-11-06T00:19:56.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37902024-11-06T00:19:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37912024-11-06T00:19:56.146ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37922024-11-06T00:19:56.146ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "78bd2e16-202c-4c2c-9390-63d6b7737f10", "content-length": "691", "date": "Wed, 06 Nov 2024 00:19:55 GMT"} })
37932024-11-06T00:19:56.146ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
37942024-11-06T00:19:56.146ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
37952024-11-06T00:19:56.146ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
37962024-11-06T00:19:56.148ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 340.577832ms iteration = 2 status = {}
37972024-11-06T00:19:56.200ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37982024-11-06T00:19:56.201ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d9a5128-ba91-46c2-8c86-d4df0305e06f", "content-length": "121", "date": "Wed, 06 Nov 2024 00:19:55 GMT"} })
37992024-11-06T00:19:56.201ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
38002024-11-06T00:19:56.201ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
38012024-11-06T00:19:56.201ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38022024-11-06T00:19:56.201ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38032024-11-06T00:19:56.201ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38042024-11-06T00:19:56.201ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38052024-11-06T00:19:56.201ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38062024-11-06T00:19:56.201ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38072024-11-06T00:19:56.201ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38082024-11-06T00:19:56.201ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38092024-11-06T00:19:56.202ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
38102024-11-06T00:19:56.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38112024-11-06T00:19:56.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38122024-11-06T00:19:56.213ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38132024-11-06T00:19:56.213ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "281465c8-1cbc-416a-bc52-6572cf882135", "content-length": "2", "date": "Wed, 06 Nov 2024 00:19:55 GMT"} })
38142024-11-06T00:19:56.214ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38152024-11-06T00:19:56.214ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "54884a84-869f-4fa1-8858-eadf2f2df3b5", "content-length": "52", "date": "Wed, 06 Nov 2024 00:19:55 GMT"} })
38162024-11-06T00:19:56.214ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
38172024-11-06T00:19:56.214ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38182024-11-06T00:19:56.309ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "61e1ed29-3ec7-4cb7-a449-9c0fb9640d8d", "date": "Wed, 06 Nov 2024 00:19:55 GMT"} })
38192024-11-06T00:19:56.309ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
38202024-11-06T00:19:56.311ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38212024-11-06T00:19:56.312ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e67c8ce5-351d-413f-8b24-a84f6554878c", "content-length": "669", "date": "Wed, 06 Nov 2024 00:19:55 GMT"} })
38222024-11-06T00:19:56.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38232024-11-06T00:19:56.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38242024-11-06T00:19:56.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38252024-11-06T00:19:56.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38262024-11-06T00:19:56.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38272024-11-06T00:19:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38282024-11-06T00:19:56.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38292024-11-06T00:19:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38302024-11-06T00:19:56.357ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 549.262377ms iteration = 2 status = {}
38312024-11-06T00:20:01.478ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1052 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 62da7e1d-c5f3-4d79-bd87-c207caab1aae response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
38322024-11-06T00:20:05.807ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
38332024-11-06T00:20:05.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38342024-11-06T00:20:05.807ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
38352024-11-06T00:20:05.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38362024-11-06T00:20:05.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38372024-11-06T00:20:05.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38382024-11-06T00:20:05.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38392024-11-06T00:20:05.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38402024-11-06T00:20:05.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38412024-11-06T00:20:05.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38422024-11-06T00:20:05.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38432024-11-06T00:20:05.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38442024-11-06T00:20:05.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38452024-11-06T00:20:05.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
38462024-11-06T00:20:05.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38472024-11-06T00:20:05.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38482024-11-06T00:20:05.831ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
38492024-11-06T00:20:05.831ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.521419ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
38502024-11-06T00:20:05.836ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38512024-11-06T00:20:05.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38522024-11-06T00:20:05.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.337912ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38532024-11-06T00:20:15.807ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
38542024-11-06T00:20:15.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38552024-11-06T00:20:15.807ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
38562024-11-06T00:20:15.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38572024-11-06T00:20:15.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38582024-11-06T00:20:15.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38592024-11-06T00:20:15.809ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38602024-11-06T00:20:15.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38612024-11-06T00:20:15.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38622024-11-06T00:20:15.811ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.067221ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38632024-11-06T00:20:15.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38642024-11-06T00:20:15.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38652024-11-06T00:20:15.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38662024-11-06T00:20:15.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38672024-11-06T00:20:15.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38682024-11-06T00:20:15.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38692024-11-06T00:20:15.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
38702024-11-06T00:20:15.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38712024-11-06T00:20:15.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38722024-11-06T00:20:15.829ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
38732024-11-06T00:20:15.829ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.277361ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
38742024-11-06T00:20:16.478ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1226 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = aafa66fc-82bf-4541-b1b2-1f61fa473349 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
38752024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
38762024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
38772024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38782024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
38792024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
38802024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
38812024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
38822024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
38832024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.95\u{b5}s iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
38842024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
38852024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
38862024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.42\u{b5}s iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
38872024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38882024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
38892024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
38902024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38912024-11-06T00:20:25.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
38922024-11-06T00:20:25.807ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38932024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
38942024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38952024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38962024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
38972024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
38982024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38992024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
39002024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.78\u{b5}s iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
39012024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
39022024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
39032024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39042024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Timeout
39052024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
39062024-11-06T00:20:25.807ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846
39072024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
39082024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.65\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846"}
39092024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39102024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
39112024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
39122024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.26\u{b5}s iteration = 3 status = {"errors":[],"records_set_to_done":[]}
39132024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
39142024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39152024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
39162024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39172024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
39182024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39192024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
39202024-11-06T00:20:25.807ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-06 00:10:25.807024002 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
39212024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
39222024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
39232024-11-06T00:20:25.807ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
39242024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
39252024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39262024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
39272024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39282024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Timeout
39292024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
39302024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
39312024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39322024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39332024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
39342024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
39352024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39362024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39372024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39382024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
39392024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39402024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
39412024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
39422024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39432024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39442024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39452024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39462024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39472024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39482024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39492024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39502024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39512024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39522024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
39532024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39542024-11-06T00:20:25.807ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("309c9aef-da72-4f08-9f70-c20d80316472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1089, tv_nsec: 146172284 } })
39552024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39562024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39572024-11-06T00:20:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39582024-11-06T00:20:25.807ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51df9631-cef5-49ae-8cfd-f0c05bdac388.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7102227a-61f8-4dda-a9a0-f6678fae71c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1089, tv_nsec: 146265647 } })
39592024-11-06T00:20:25.808ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
39602024-11-06T00:20:25.808ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.245137ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
39612024-11-06T00:20:25.808ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
39622024-11-06T00:20:25.808ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.544455ms iteration = 3 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
39632024-11-06T00:20:25.809ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39642024-11-06T00:20:25.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39652024-11-06T00:20:25.811ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.39584ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
39662024-11-06T00:20:25.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39672024-11-06T00:20:25.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39682024-11-06T00:20:25.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39692024-11-06T00:20:25.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39702024-11-06T00:20:25.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39712024-11-06T00:20:25.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39722024-11-06T00:20:25.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39732024-11-06T00:20:25.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39742024-11-06T00:20:25.815ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.616245ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39752024-11-06T00:20:25.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39762024-11-06T00:20:25.816ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1089, tv_nsec: 154859082 } })
39772024-11-06T00:20:25.816ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
39782024-11-06T00:20:25.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39792024-11-06T00:20:25.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39802024-11-06T00:20:25.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39812024-11-06T00:20:25.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39822024-11-06T00:20:25.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39832024-11-06T00:20:25.821ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39842024-11-06T00:20:25.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39852024-11-06T00:20:25.821ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1089, tv_nsec: 160110258 } })
39862024-11-06T00:20:25.821ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-06 00:10:25.807024002 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
39872024-11-06T00:20:25.821ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.82527ms iteration = 2 status = {"expiration":"2024-11-06T00:10:25.807024002Z","pruned":[]}
39882024-11-06T00:20:25.821ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
39892024-11-06T00:20:25.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39902024-11-06T00:20:25.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39912024-11-06T00:20:25.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39922024-11-06T00:20:25.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39932024-11-06T00:20:25.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39942024-11-06T00:20:25.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39952024-11-06T00:20:25.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39962024-11-06T00:20:25.830ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1089, tv_nsec: 169103185 } })
39972024-11-06T00:20:25.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39982024-11-06T00:20:25.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39992024-11-06T00:20:25.831ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
40002024-11-06T00:20:25.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40012024-11-06T00:20:25.834ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40022024-11-06T00:20:25.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40032024-11-06T00:20:25.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40042024-11-06T00:20:25.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40052024-11-06T00:20:25.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40062024-11-06T00:20:25.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40072024-11-06T00:20:25.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40082024-11-06T00:20:25.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40092024-11-06T00:20:25.862ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
40102024-11-06T00:20:25.862ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
40112024-11-06T00:20:25.862ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 55.482187ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
40122024-11-06T00:20:25.863ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40132024-11-06T00:20:25.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40142024-11-06T00:20:25.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40152024-11-06T00:20:25.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40162024-11-06T00:20:25.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40172024-11-06T00:20:25.866ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40182024-11-06T00:20:25.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40192024-11-06T00:20:25.866ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40202024-11-06T00:20:25.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40212024-11-06T00:20:25.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40222024-11-06T00:20:25.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40232024-11-06T00:20:25.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40242024-11-06T00:20:25.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40252024-11-06T00:20:25.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40262024-11-06T00:20:25.871ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40272024-11-06T00:20:25.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40282024-11-06T00:20:25.872ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40292024-11-06T00:20:25.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40302024-11-06T00:20:25.872ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
40312024-11-06T00:20:25.872ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
40322024-11-06T00:20:25.872ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
40332024-11-06T00:20:25.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40342024-11-06T00:20:25.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40352024-11-06T00:20:25.873ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40362024-11-06T00:20:25.873ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40372024-11-06T00:20:25.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40382024-11-06T00:20:25.873ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40392024-11-06T00:20:25.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40402024-11-06T00:20:25.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40412024-11-06T00:20:25.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40422024-11-06T00:20:25.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40432024-11-06T00:20:25.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40442024-11-06T00:20:25.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40452024-11-06T00:20:25.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40462024-11-06T00:20:25.877ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40472024-11-06T00:20:25.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.922705ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40482024-11-06T00:20:25.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40492024-11-06T00:20:25.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40502024-11-06T00:20:25.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40512024-11-06T00:20:25.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40522024-11-06T00:20:25.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40532024-11-06T00:20:25.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40542024-11-06T00:20:25.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40552024-11-06T00:20:25.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
40562024-11-06T00:20:25.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40572024-11-06T00:20:25.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40582024-11-06T00:20:25.901ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40592024-11-06T00:20:25.901ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 94.623989ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40602024-11-06T00:20:25.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40612024-11-06T00:20:25.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40622024-11-06T00:20:25.916ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
40632024-11-06T00:20:25.916ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 109.882162ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
40642024-11-06T00:20:25.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40652024-11-06T00:20:25.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40662024-11-06T00:20:25.920ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 113.825219ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40672024-11-06T00:20:25.922ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
40682024-11-06T00:20:25.922ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
40692024-11-06T00:20:25.922ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 115.425437ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
40702024-11-06T00:20:25.923ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40712024-11-06T00:20:25.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40722024-11-06T00:20:25.923ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
40732024-11-06T00:20:25.923ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
40742024-11-06T00:20:25.923ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
40752024-11-06T00:20:25.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40762024-11-06T00:20:25.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40772024-11-06T00:20:25.925ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40782024-11-06T00:20:25.928ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40792024-11-06T00:20:25.928ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40802024-11-06T00:20:25.928ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40812024-11-06T00:20:25.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40822024-11-06T00:20:25.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
40832024-11-06T00:20:25.929ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40842024-11-06T00:20:25.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40852024-11-06T00:20:25.930ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40862024-11-06T00:20:25.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40872024-11-06T00:20:25.931ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 124.768764ms iteration = 3 status = 0
40882024-11-06T00:20:25.932ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
40892024-11-06T00:20:25.932ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
40902024-11-06T00:20:25.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40912024-11-06T00:20:25.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40922024-11-06T00:20:25.932ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40932024-11-06T00:20:25.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40942024-11-06T00:20:25.934ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40952024-11-06T00:20:25.934ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40962024-11-06T00:20:25.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40972024-11-06T00:20:25.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40982024-11-06T00:20:25.938ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40992024-11-06T00:20:25.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41002024-11-06T00:20:25.942ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
41012024-11-06T00:20:25.942ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
41022024-11-06T00:20:25.942ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-06 00:19:33.391850 UTC dns_group = external generation = 2
41032024-11-06T00:20:25.942ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 135.360949ms iteration = 3 status = {"generation":2}
41042024-11-06T00:20:25.954ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
41052024-11-06T00:20:25.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41062024-11-06T00:20:25.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41072024-11-06T00:20:25.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41082024-11-06T00:20:25.973ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41092024-11-06T00:20:25.973ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41102024-11-06T00:20:25.973ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 166.667418ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41112024-11-06T00:20:25.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41122024-11-06T00:20:25.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41132024-11-06T00:20:25.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41142024-11-06T00:20:25.977ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 170.171492ms iteration = 5 status = {"physical_disks_added":0}
41152024-11-06T00:20:25.978ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
41162024-11-06T00:20:25.978ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41172024-11-06T00:20:25.978ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c090c563-3d0d-46a5-99ef-5950905880d0", "content-length": "26", "date": "Wed, 06 Nov 2024 00:20:25 GMT"} })
41182024-11-06T00:20:25.978ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41192024-11-06T00:20:25.980ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41202024-11-06T00:20:25.982ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-06T00:19:22.736570Z, time_modified: 2024-11-06T00:19:22.736570Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
41212024-11-06T00:20:25.982ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 175.240062ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]}},"default_endpoint":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
41222024-11-06T00:20:25.996ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
41232024-11-06T00:20:25.996ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 189.439775ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
41242024-11-06T00:20:26.016ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
41252024-11-06T00:20:26.016ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41262024-11-06T00:20:26.016ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fe63fc7-569e-4691-97be-bc14fbf8f731", "content-length": "26", "date": "Wed, 06 Nov 2024 00:20:25 GMT"} })
41272024-11-06T00:20:26.016ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41282024-11-06T00:20:26.018ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
41292024-11-06T00:20:26.079ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41302024-11-06T00:20:26.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41312024-11-06T00:20:26.080ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
41322024-11-06T00:20:26.162ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41332024-11-06T00:20:26.162ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41342024-11-06T00:20:26.162ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "082eda8d-8d83-49fa-9d76-f34a952d53ed", "content-length": "372", "date": "Wed, 06 Nov 2024 00:20:25 GMT"} })
41352024-11-06T00:20:26.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41362024-11-06T00:20:26.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41372024-11-06T00:20:26.164ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
41382024-11-06T00:20:26.164ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
41392024-11-06T00:20:26.164ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41402024-11-06T00:20:26.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41412024-11-06T00:20:26.166ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
41422024-11-06T00:20:26.166ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41432024-11-06T00:20:26.166ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2070836e-daad-43e6-8d8f-67a7ae397d21", "content-length": "26", "date": "Wed, 06 Nov 2024 00:20:25 GMT"} })
41442024-11-06T00:20:26.166ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41452024-11-06T00:20:26.168ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41462024-11-06T00:20:26.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41472024-11-06T00:20:26.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41482024-11-06T00:20:26.206ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41492024-11-06T00:20:26.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41502024-11-06T00:20:26.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41512024-11-06T00:20:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41522024-11-06T00:20:26.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41532024-11-06T00:20:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41542024-11-06T00:20:26.211ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
41552024-11-06T00:20:26.211ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41562024-11-06T00:20:26.211ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-06 00:19:32.804378 UTC dns_group = internal generation = 1
41572024-11-06T00:20:26.211ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 404.674685ms iteration = 3 status = {"generation":1}
41582024-11-06T00:20:26.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41592024-11-06T00:20:26.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41602024-11-06T00:20:26.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41612024-11-06T00:20:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41622024-11-06T00:20:26.256ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
41632024-11-06T00:20:26.256ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41642024-11-06T00:20:26.271ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41652024-11-06T00:20:26.272ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d76c8a36-20d4-41a1-ba13-426b59358d38", "content-length": "1", "date": "Wed, 06 Nov 2024 00:20:25 GMT"} })
41662024-11-06T00:20:26.273ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41672024-11-06T00:20:26.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41682024-11-06T00:20:26.275ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41692024-11-06T00:20:26.275ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "867ba20d-b59b-4689-b4f8-f98cb1b9a3fe", "date": "Wed, 06 Nov 2024 00:20:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41702024-11-06T00:20:26.275ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41712024-11-06T00:20:26.275ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 468.754897ms iteration = 3 status = null
41722024-11-06T00:20:26.276ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "342ab5cb-8d3e-4e30-84df-78d06db470b0", "date": "Wed, 06 Nov 2024 00:20:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41732024-11-06T00:20:26.276ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41742024-11-06T00:20:26.278ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41752024-11-06T00:20:26.278ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 471.420496ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41762024-11-06T00:20:26.282ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
41772024-11-06T00:20:26.308ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 501.161459ms iteration = 3 status = {}
41782024-11-06T00:20:26.339ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8b528679-adaa-4de2-84f9-232007988c65", "date": "Wed, 06 Nov 2024 00:20:25 GMT"} })
41792024-11-06T00:20:26.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41802024-11-06T00:20:26.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41812024-11-06T00:20:26.367ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41822024-11-06T00:20:26.367ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a7f4e18-dee2-4bdf-82d2-8c9e822964d0", "content-length": "691", "date": "Wed, 06 Nov 2024 00:20:25 GMT"} })
41832024-11-06T00:20:26.367ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
41842024-11-06T00:20:26.367ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
41852024-11-06T00:20:26.367ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
41862024-11-06T00:20:26.368ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 561.412417ms iteration = 3 status = {}
41872024-11-06T00:20:26.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41882024-11-06T00:20:26.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41892024-11-06T00:20:26.370ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
41902024-11-06T00:20:26.370ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "31e33d35-537b-427f-8df0-0f99aa7d77fb", "date": "Wed, 06 Nov 2024 00:20:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41912024-11-06T00:20:26.370ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41922024-11-06T00:20:26.371ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9a277af8-5fe4-4090-81f2-91cd3113937e", "date": "Wed, 06 Nov 2024 00:20:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41932024-11-06T00:20:26.371ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41942024-11-06T00:20:26.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41952024-11-06T00:20:26.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41962024-11-06T00:20:26.373ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a95eb9a3-78dd-4f0b-ab10-cb41287264cd", "date": "Wed, 06 Nov 2024 00:20:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41972024-11-06T00:20:26.373ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41982024-11-06T00:20:26.375ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41992024-11-06T00:20:26.375ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 568.681234ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
42002024-11-06T00:20:26.376ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
42012024-11-06T00:20:26.376ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42022024-11-06T00:20:26.376ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "486b8d7d-9a44-438c-a5a1-11bd42a48519", "date": "Wed, 06 Nov 2024 00:20:25 GMT"} })
42032024-11-06T00:20:26.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42042024-11-06T00:20:26.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42052024-11-06T00:20:26.378ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 571.116296ms iteration = 4 status = {}
42062024-11-06T00:20:26.379ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
42072024-11-06T00:20:26.379ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42082024-11-06T00:20:26.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42092024-11-06T00:20:26.388ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42102024-11-06T00:20:26.388ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5cfb478b-cffb-4326-9cc4-f701013bc857", "content-length": "121", "date": "Wed, 06 Nov 2024 00:20:25 GMT"} })
42112024-11-06T00:20:26.388ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
42122024-11-06T00:20:26.388ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
42132024-11-06T00:20:26.388ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42142024-11-06T00:20:26.388ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42152024-11-06T00:20:26.388ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42162024-11-06T00:20:26.388ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42172024-11-06T00:20:26.388ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42182024-11-06T00:20:26.388ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42192024-11-06T00:20:26.388ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42202024-11-06T00:20:26.388ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42212024-11-06T00:20:26.389ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
42222024-11-06T00:20:26.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42232024-11-06T00:20:26.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42242024-11-06T00:20:26.397ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42252024-11-06T00:20:26.397ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7962b4df-2976-4b53-b8ac-cda256f16283", "content-length": "2", "date": "Wed, 06 Nov 2024 00:20:25 GMT"} })
42262024-11-06T00:20:26.397ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42272024-11-06T00:20:26.397ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ade74c73-73d8-45bb-ac13-b19a04267a28", "content-length": "52", "date": "Wed, 06 Nov 2024 00:20:25 GMT"} })
42282024-11-06T00:20:26.397ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
42292024-11-06T00:20:26.397ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42302024-11-06T00:20:26.486ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e14cf79e-01dc-403a-ae78-3b6fc9c7aba2", "date": "Wed, 06 Nov 2024 00:20:25 GMT"} })
42312024-11-06T00:20:26.486ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
42322024-11-06T00:20:26.486ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42332024-11-06T00:20:26.490ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c9b7675-dac7-4aad-a520-ce18632f56cd", "content-length": "669", "date": "Wed, 06 Nov 2024 00:20:25 GMT"} })
42342024-11-06T00:20:26.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42352024-11-06T00:20:26.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42362024-11-06T00:20:26.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42372024-11-06T00:20:26.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42382024-11-06T00:20:26.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42392024-11-06T00:20:26.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42402024-11-06T00:20:26.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42412024-11-06T00:20:26.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42422024-11-06T00:20:26.608ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 801.890148ms iteration = 3 status = {}
42432024-11-06T00:20:29.945ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:50717
42442024-11-06T00:20:29.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50717 req_id = 0b1700f0-070e-4937-ac09-0c7b61b9e100 roles = RoleSet { roles: {} } uri = /metrics/producers
42452024-11-06T00:20:29.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50717 req_id = 0b1700f0-070e-4937-ac09-0c7b61b9e100 resource = Database result = Ok(()) uri = /metrics/producers
42462024-11-06T00:20:30.000ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = 7c647f25-eb29-494d-840d-11658133af45
42472024-11-06T00:20:30.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54902 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50717 req_id = 0b1700f0-070e-4937-ac09-0c7b61b9e100 response_code = 201 uri = /metrics/producers
42482024-11-06T00:20:31.481ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1615 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 36251f90-35aa-41ba-bc8a-7d8e76190246 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
42492024-11-06T00:20:35.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
42502024-11-06T00:20:35.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42512024-11-06T00:20:35.806ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
42522024-11-06T00:20:35.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42532024-11-06T00:20:35.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42542024-11-06T00:20:35.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42552024-11-06T00:20:35.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42562024-11-06T00:20:35.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42572024-11-06T00:20:35.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42582024-11-06T00:20:35.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42592024-11-06T00:20:35.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42602024-11-06T00:20:35.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42612024-11-06T00:20:35.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42622024-11-06T00:20:35.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42632024-11-06T00:20:35.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42642024-11-06T00:20:35.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
42652024-11-06T00:20:35.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42662024-11-06T00:20:35.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42672024-11-06T00:20:35.854ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
42682024-11-06T00:20:35.854ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.444779ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
42692024-11-06T00:20:35.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.322501ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42702024-11-06T00:20:45.807ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
42712024-11-06T00:20:45.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42722024-11-06T00:20:45.807ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
42732024-11-06T00:20:45.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42742024-11-06T00:20:45.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42752024-11-06T00:20:45.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42762024-11-06T00:20:45.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42772024-11-06T00:20:45.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42782024-11-06T00:20:45.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42792024-11-06T00:20:45.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42802024-11-06T00:20:45.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42812024-11-06T00:20:45.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42822024-11-06T00:20:45.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.027269ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42832024-11-06T00:20:45.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42842024-11-06T00:20:45.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42852024-11-06T00:20:45.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42862024-11-06T00:20:45.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
42872024-11-06T00:20:45.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42882024-11-06T00:20:45.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42892024-11-06T00:20:45.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
42902024-11-06T00:20:45.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.802627ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
42912024-11-06T00:20:46.477ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1191 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 0963fc86-37b0-4b49-8aee-9f687def9eb7 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
42922024-11-06T00:20:55.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
42932024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42942024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
42952024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
42962024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42972024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
42982024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42992024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43002024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
43012024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 12.221\u{b5}s iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
43022024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
43032024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
43042024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.26\u{b5}s iteration = 4 status = {"errors":[],"records_set_to_done":[]}
43052024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
43062024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.95\u{b5}s iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
43072024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
43082024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
43092024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.56\u{b5}s iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
43102024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
43112024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
43122024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
43132024-11-06T00:20:55.807ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43142024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43152024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43162024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43172024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43182024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
43192024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43202024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
43212024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43222024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
43232024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43242024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
43252024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43262024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43272024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43282024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43292024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43302024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43312024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43322024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43332024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43342024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43352024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43362024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43372024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43382024-11-06T00:20:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43392024-11-06T00:20:55.809ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43402024-11-06T00:20:55.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43412024-11-06T00:20:55.810ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1119, tv_nsec: 149032139 } })
43422024-11-06T00:20:55.810ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
43432024-11-06T00:20:55.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43442024-11-06T00:20:55.811ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.35105ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43452024-11-06T00:20:55.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43462024-11-06T00:20:55.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43472024-11-06T00:20:55.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43482024-11-06T00:20:55.813ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43492024-11-06T00:20:55.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43502024-11-06T00:20:55.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43512024-11-06T00:20:55.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43522024-11-06T00:20:55.816ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1119, tv_nsec: 155128110 } })
43532024-11-06T00:20:55.816ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
43542024-11-06T00:20:55.816ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43552024-11-06T00:20:55.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43562024-11-06T00:20:55.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43572024-11-06T00:20:55.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43582024-11-06T00:20:55.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43592024-11-06T00:20:55.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43602024-11-06T00:20:55.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43612024-11-06T00:20:55.820ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43622024-11-06T00:20:55.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43632024-11-06T00:20:55.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43642024-11-06T00:20:55.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1119, tv_nsec: 160928902 } })
43652024-11-06T00:20:55.822ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
43662024-11-06T00:20:55.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43672024-11-06T00:20:55.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43682024-11-06T00:20:55.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43692024-11-06T00:20:55.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43702024-11-06T00:20:55.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43712024-11-06T00:20:55.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43722024-11-06T00:20:55.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43732024-11-06T00:20:55.848ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43742024-11-06T00:20:55.848ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43752024-11-06T00:20:55.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43762024-11-06T00:20:55.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43772024-11-06T00:20:55.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43782024-11-06T00:20:55.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43792024-11-06T00:20:55.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43802024-11-06T00:20:55.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43812024-11-06T00:20:55.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43822024-11-06T00:20:55.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43832024-11-06T00:20:55.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43842024-11-06T00:20:55.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43852024-11-06T00:20:55.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
43862024-11-06T00:20:55.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43872024-11-06T00:20:55.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43882024-11-06T00:20:55.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43892024-11-06T00:20:55.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43902024-11-06T00:20:55.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.616533ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43912024-11-06T00:20:55.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43922024-11-06T00:20:55.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43932024-11-06T00:20:55.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43942024-11-06T00:20:55.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43952024-11-06T00:20:55.879ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
43962024-11-06T00:20:55.879ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43972024-11-06T00:20:55.880ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "da2d5ad7-03f0-4554-88f1-ab61f1aff790", "content-length": "26", "date": "Wed, 06 Nov 2024 00:20:55 GMT"} })
43982024-11-06T00:20:55.880ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43992024-11-06T00:20:55.881ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44002024-11-06T00:20:55.883ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44012024-11-06T00:20:55.883ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44022024-11-06T00:20:55.883ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44032024-11-06T00:20:55.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44042024-11-06T00:20:55.897ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
44052024-11-06T00:20:55.897ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44062024-11-06T00:20:55.898ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db5e06ad-b289-4ee6-9640-0ef64bff90e7", "content-length": "26", "date": "Wed, 06 Nov 2024 00:20:55 GMT"} })
44072024-11-06T00:20:55.898ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44082024-11-06T00:20:55.899ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44092024-11-06T00:20:55.899ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.701002ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44102024-11-06T00:20:55.900ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
44112024-11-06T00:20:55.904ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
44122024-11-06T00:20:55.904ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44132024-11-06T00:20:55.905ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f07f523-af01-4ed9-8eaa-177c965c1a17", "content-length": "26", "date": "Wed, 06 Nov 2024 00:20:55 GMT"} })
44142024-11-06T00:20:55.905ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44152024-11-06T00:20:55.907ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44162024-11-06T00:20:55.915ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44172024-11-06T00:20:55.915ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44182024-11-06T00:20:55.915ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.173802ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44192024-11-06T00:20:55.922ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44202024-11-06T00:20:55.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44212024-11-06T00:20:55.946ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44222024-11-06T00:20:55.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44232024-11-06T00:20:55.973ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 166.855704ms iteration = 6 status = {"physical_disks_added":0}
44242024-11-06T00:20:55.976ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
44252024-11-06T00:20:55.976ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 169.531373ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
44262024-11-06T00:20:55.988ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 181.750406ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44272024-11-06T00:20:56.016ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44282024-11-06T00:20:56.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44292024-11-06T00:20:56.017ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
44302024-11-06T00:20:56.017ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44312024-11-06T00:20:56.017ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6c6378e-3235-45a4-9a58-8a85482f8d1b", "content-length": "372", "date": "Wed, 06 Nov 2024 00:20:55 GMT"} })
44322024-11-06T00:20:56.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44332024-11-06T00:20:56.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44342024-11-06T00:20:56.024ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44352024-11-06T00:20:56.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44362024-11-06T00:20:56.025ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44372024-11-06T00:20:56.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44382024-11-06T00:20:56.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44392024-11-06T00:20:56.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
44402024-11-06T00:20:56.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44412024-11-06T00:20:56.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44422024-11-06T00:20:56.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44432024-11-06T00:20:56.031ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 224.221066ms iteration = 4 status = 0
44442024-11-06T00:20:56.031ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44452024-11-06T00:20:56.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44462024-11-06T00:20:56.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44472024-11-06T00:20:56.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44482024-11-06T00:20:56.073ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44492024-11-06T00:20:56.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44502024-11-06T00:20:56.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44512024-11-06T00:20:56.073ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
44522024-11-06T00:20:56.073ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
44532024-11-06T00:20:56.074ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c83522f7-a429-4545-afd1-31761a4898d6", "date": "Wed, 06 Nov 2024 00:20:55 GMT"} })
44542024-11-06T00:20:56.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44552024-11-06T00:20:56.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44562024-11-06T00:20:56.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44572024-11-06T00:20:56.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44582024-11-06T00:20:56.077ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44592024-11-06T00:20:56.077ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fd2f262-87a7-45ed-b49c-5572b55f9cb0", "content-length": "1", "date": "Wed, 06 Nov 2024 00:20:55 GMT"} })
44602024-11-06T00:20:56.078ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44612024-11-06T00:20:56.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44622024-11-06T00:20:56.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44632024-11-06T00:20:56.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44642024-11-06T00:20:56.080ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 273.878052ms iteration = 4 status = null
44652024-11-06T00:20:56.082ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
44662024-11-06T00:20:56.082ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44672024-11-06T00:20:56.083ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "502012cd-503c-4cdb-9cdf-2b0cc3272236", "date": "Wed, 06 Nov 2024 00:20:55 GMT"} })
44682024-11-06T00:20:56.084ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 277.659244ms iteration = 5 status = {}
44692024-11-06T00:20:56.093ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 286.521447ms iteration = 4 status = {}
44702024-11-06T00:20:56.143ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44712024-11-06T00:20:56.143ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "910401c0-4501-454c-b73e-e74002b70d66", "content-length": "691", "date": "Wed, 06 Nov 2024 00:20:55 GMT"} })
44722024-11-06T00:20:56.143ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
44732024-11-06T00:20:56.143ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
44742024-11-06T00:20:56.143ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
44752024-11-06T00:20:56.145ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 338.660615ms iteration = 4 status = {}
44762024-11-06T00:20:56.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44772024-11-06T00:20:56.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44782024-11-06T00:20:56.162ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
44792024-11-06T00:20:56.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44802024-11-06T00:20:56.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44812024-11-06T00:20:56.172ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44822024-11-06T00:20:56.172ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "acc19452-6831-4c51-9d5d-193819f8c09f", "content-length": "121", "date": "Wed, 06 Nov 2024 00:20:55 GMT"} })
44832024-11-06T00:20:56.172ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
44842024-11-06T00:20:56.172ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
44852024-11-06T00:20:56.173ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
44862024-11-06T00:20:56.173ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44872024-11-06T00:20:56.173ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44882024-11-06T00:20:56.173ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44892024-11-06T00:20:56.173ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44902024-11-06T00:20:56.173ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44912024-11-06T00:20:56.173ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44922024-11-06T00:20:56.173ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44932024-11-06T00:20:56.173ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
44942024-11-06T00:20:56.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44952024-11-06T00:20:56.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44962024-11-06T00:20:56.175ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44972024-11-06T00:20:56.175ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ceb48e5c-ff23-4497-87e3-d04787b554d0", "content-length": "2", "date": "Wed, 06 Nov 2024 00:20:55 GMT"} })
44982024-11-06T00:20:56.175ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44992024-11-06T00:20:56.176ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed239402-83e5-4208-b475-a710f460dd9b", "content-length": "52", "date": "Wed, 06 Nov 2024 00:20:55 GMT"} })
45002024-11-06T00:20:56.176ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
45012024-11-06T00:20:56.176ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45022024-11-06T00:20:56.273ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b1d713ff-cbc3-438e-b7fd-bc6f965b88f2", "date": "Wed, 06 Nov 2024 00:20:55 GMT"} })
45032024-11-06T00:20:56.273ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
45042024-11-06T00:20:56.273ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45052024-11-06T00:20:56.273ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2c6fc93-b72e-497d-9c77-e00319ee4b0d", "content-length": "669", "date": "Wed, 06 Nov 2024 00:20:55 GMT"} })
45062024-11-06T00:20:56.273ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45072024-11-06T00:20:56.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45082024-11-06T00:20:56.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45092024-11-06T00:20:56.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45102024-11-06T00:20:56.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45112024-11-06T00:20:56.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45122024-11-06T00:20:56.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45132024-11-06T00:20:56.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45142024-11-06T00:20:56.291ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 484.218096ms iteration = 4 status = {}
45152024-11-06T00:20:58.878ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:61171
45162024-11-06T00:20:58.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61171 req_id = cb961577-2540-4f75-ba3e-69b04fc6f97b roles = RoleSet { roles: {} } uri = /metrics/producers
45172024-11-06T00:20:58.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61171 req_id = cb961577-2540-4f75-ba3e-69b04fc6f97b resource = Database result = Ok(()) uri = /metrics/producers
45182024-11-06T00:20:58.915ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = eeaea349-a304-4c2f-97f2-4ab76b77beee
45192024-11-06T00:20:58.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36590 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61171 req_id = cb961577-2540-4f75-ba3e-69b04fc6f97b response_code = 201 uri = /metrics/producers
45202024-11-06T00:21:01.477ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1052 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = cb42e161-25c9-4e34-b953-997c6af8369a response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
45212024-11-06T00:21:05.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
45222024-11-06T00:21:05.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45232024-11-06T00:21:05.806ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
45242024-11-06T00:21:05.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45252024-11-06T00:21:05.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45262024-11-06T00:21:05.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45272024-11-06T00:21:05.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45282024-11-06T00:21:05.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45292024-11-06T00:21:05.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45302024-11-06T00:21:05.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.919846ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45312024-11-06T00:21:05.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45322024-11-06T00:21:05.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45332024-11-06T00:21:05.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45342024-11-06T00:21:05.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45352024-11-06T00:21:05.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45362024-11-06T00:21:05.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45372024-11-06T00:21:05.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
45382024-11-06T00:21:05.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45392024-11-06T00:21:05.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45402024-11-06T00:21:05.828ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
45412024-11-06T00:21:05.828ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.903451ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
45422024-11-06T00:21:15.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
45432024-11-06T00:21:15.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45442024-11-06T00:21:15.806ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
45452024-11-06T00:21:15.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45462024-11-06T00:21:15.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45472024-11-06T00:21:15.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45482024-11-06T00:21:15.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45492024-11-06T00:21:15.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45502024-11-06T00:21:15.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45512024-11-06T00:21:15.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.36077ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45522024-11-06T00:21:15.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45532024-11-06T00:21:15.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45542024-11-06T00:21:15.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45552024-11-06T00:21:15.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45562024-11-06T00:21:15.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45572024-11-06T00:21:15.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45582024-11-06T00:21:15.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
45592024-11-06T00:21:15.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45602024-11-06T00:21:15.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45612024-11-06T00:21:15.827ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
45622024-11-06T00:21:15.827ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.282092ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
45632024-11-06T00:21:16.479ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1117 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 7913ca18-9da6-480e-bdf3-aa4038cd74f7 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
45642024-11-06T00:21:19.665ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:41011
45652024-11-06T00:21:19.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41011 req_id = aa4cda1b-8e24-48e1-9d8f-2a6eef348dba roles = RoleSet { roles: {} } uri = /metrics/producers
45662024-11-06T00:21:19.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41011 req_id = aa4cda1b-8e24-48e1-9d8f-2a6eef348dba resource = Database result = Ok(()) uri = /metrics/producers
45672024-11-06T00:21:19.676ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = 9c1a1f66-8a95-49da-beda-497b56ec3bbf
45682024-11-06T00:21:19.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11122 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41011 req_id = aa4cda1b-8e24-48e1-9d8f-2a6eef348dba response_code = 201 uri = /metrics/producers
45692024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
45702024-11-06T00:21:25.806ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
45712024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
45722024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
45732024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45742024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45752024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
45762024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
45772024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.07\u{b5}s iteration = 5 status = {"errors":[],"records_set_to_done":[]}
45782024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
45792024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
45802024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45812024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
45822024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
45832024-11-06T00:21:25.806ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846
45842024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
45852024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.231\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846"}
45862024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 10.69\u{b5}s iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
45872024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
45882024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
45892024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
45902024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.49\u{b5}s iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
45912024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
45922024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
45932024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
45942024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45952024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
45962024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.56\u{b5}s iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
45972024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
45982024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
45992024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
46002024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46012024-11-06T00:21:25.806ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
46022024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
46032024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
46042024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
46052024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46062024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46072024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
46082024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46092024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
46102024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
46112024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
46122024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46132024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
46142024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
46152024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46162024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46172024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46182024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
46192024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
46202024-11-06T00:21:25.806ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-06 00:11:25.806294816 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
46212024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46222024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
46232024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
46242024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46252024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
46262024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
46272024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
46282024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46292024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
46302024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46312024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46322024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46332024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46342024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46352024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46362024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
46372024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46382024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
46392024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
46402024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46412024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46422024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46432024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46442024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46452024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46462024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46472024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
46482024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46492024-11-06T00:21:25.806ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("309c9aef-da72-4f08-9f70-c20d80316472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1149, tv_nsec: 146250196 } })
46502024-11-06T00:21:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
46512024-11-06T00:21:25.806ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51df9631-cef5-49ae-8cfd-f0c05bdac388.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7102227a-61f8-4dda-a9a0-f6678fae71c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1149, tv_nsec: 146290187 } })
46522024-11-06T00:21:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46532024-11-06T00:21:25.807ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
46542024-11-06T00:21:25.807ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.270768ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
46552024-11-06T00:21:25.807ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
46562024-11-06T00:21:25.807ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.454403ms iteration = 4 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
46572024-11-06T00:21:25.808ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.71328ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46582024-11-06T00:21:25.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46592024-11-06T00:21:25.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46602024-11-06T00:21:25.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46612024-11-06T00:21:25.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46622024-11-06T00:21:25.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46632024-11-06T00:21:25.811ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.666718ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
46642024-11-06T00:21:25.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46652024-11-06T00:21:25.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46662024-11-06T00:21:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46672024-11-06T00:21:25.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46682024-11-06T00:21:25.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46692024-11-06T00:21:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46702024-11-06T00:21:25.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46712024-11-06T00:21:25.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46722024-11-06T00:21:25.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46732024-11-06T00:21:25.814ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1149, tv_nsec: 153611485 } })
46742024-11-06T00:21:25.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
46752024-11-06T00:21:25.815ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
46762024-11-06T00:21:25.815ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
46772024-11-06T00:21:25.815ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 9.888664ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
46782024-11-06T00:21:25.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46792024-11-06T00:21:25.816ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1149, tv_nsec: 156063978 } })
46802024-11-06T00:21:25.817ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
46812024-11-06T00:21:25.817ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46822024-11-06T00:21:25.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46832024-11-06T00:21:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46842024-11-06T00:21:25.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46852024-11-06T00:21:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46862024-11-06T00:21:25.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46872024-11-06T00:21:25.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46882024-11-06T00:21:25.821ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46892024-11-06T00:21:25.821ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-06 00:11:25.806294816 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
46902024-11-06T00:21:25.821ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.368126ms iteration = 3 status = {"expiration":"2024-11-06T00:11:25.806294816Z","pruned":[]}
46912024-11-06T00:21:25.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46922024-11-06T00:21:25.823ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1149, tv_nsec: 162483518 } })
46932024-11-06T00:21:25.823ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
46942024-11-06T00:21:25.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46952024-11-06T00:21:25.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46962024-11-06T00:21:25.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46972024-11-06T00:21:25.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46982024-11-06T00:21:25.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46992024-11-06T00:21:25.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47002024-11-06T00:21:25.828ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47012024-11-06T00:21:25.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47022024-11-06T00:21:25.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47032024-11-06T00:21:25.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47042024-11-06T00:21:25.863ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47052024-11-06T00:21:25.863ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47062024-11-06T00:21:25.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47072024-11-06T00:21:25.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47082024-11-06T00:21:25.866ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47092024-11-06T00:21:25.866ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47102024-11-06T00:21:25.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47112024-11-06T00:21:25.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47122024-11-06T00:21:25.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47132024-11-06T00:21:25.870ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47142024-11-06T00:21:25.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47152024-11-06T00:21:25.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47162024-11-06T00:21:25.871ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47172024-11-06T00:21:25.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47182024-11-06T00:21:25.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47192024-11-06T00:21:25.872ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47202024-11-06T00:21:25.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47212024-11-06T00:21:25.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
47222024-11-06T00:21:25.873ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47232024-11-06T00:21:25.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
47242024-11-06T00:21:25.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47252024-11-06T00:21:25.874ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47262024-11-06T00:21:25.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47272024-11-06T00:21:25.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47282024-11-06T00:21:25.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47292024-11-06T00:21:25.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47302024-11-06T00:21:25.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
47312024-11-06T00:21:25.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47322024-11-06T00:21:25.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47332024-11-06T00:21:25.876ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47342024-11-06T00:21:25.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47352024-11-06T00:21:25.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47362024-11-06T00:21:25.877ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47372024-11-06T00:21:25.877ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.934046ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47382024-11-06T00:21:25.877ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47392024-11-06T00:21:25.877ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47402024-11-06T00:21:25.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47412024-11-06T00:21:25.878ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
47422024-11-06T00:21:25.878ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
47432024-11-06T00:21:25.878ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
47442024-11-06T00:21:25.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47452024-11-06T00:21:25.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47462024-11-06T00:21:25.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47472024-11-06T00:21:25.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
47482024-11-06T00:21:25.880ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47492024-11-06T00:21:25.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47502024-11-06T00:21:25.881ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
47512024-11-06T00:21:25.881ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
47522024-11-06T00:21:25.881ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
47532024-11-06T00:21:25.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47542024-11-06T00:21:25.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47552024-11-06T00:21:25.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.844461ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47562024-11-06T00:21:25.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47572024-11-06T00:21:25.883ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47582024-11-06T00:21:25.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47592024-11-06T00:21:25.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47602024-11-06T00:21:25.887ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
47612024-11-06T00:21:25.887ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.131359ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
47622024-11-06T00:21:25.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47632024-11-06T00:21:25.888ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47642024-11-06T00:21:25.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47652024-11-06T00:21:25.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47662024-11-06T00:21:25.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47672024-11-06T00:21:25.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47682024-11-06T00:21:25.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47692024-11-06T00:21:25.893ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
47702024-11-06T00:21:25.893ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
47712024-11-06T00:21:25.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47722024-11-06T00:21:25.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47732024-11-06T00:21:25.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
47742024-11-06T00:21:25.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
47752024-11-06T00:21:25.901ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47762024-11-06T00:21:25.901ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47772024-11-06T00:21:25.901ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 94.9817ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47782024-11-06T00:21:25.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47792024-11-06T00:21:25.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47802024-11-06T00:21:25.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 111.343405ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47812024-11-06T00:21:25.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47822024-11-06T00:21:25.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47832024-11-06T00:21:25.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47842024-11-06T00:21:25.922ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
47852024-11-06T00:21:25.922ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
47862024-11-06T00:21:25.922ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 116.390305ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
47872024-11-06T00:21:25.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
47882024-11-06T00:21:25.924ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47892024-11-06T00:21:25.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47902024-11-06T00:21:25.926ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 120.639772ms iteration = 5 status = 0
47912024-11-06T00:21:25.929ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47922024-11-06T00:21:25.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47932024-11-06T00:21:25.931ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47942024-11-06T00:21:25.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47952024-11-06T00:21:25.934ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47962024-11-06T00:21:25.934ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47972024-11-06T00:21:25.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47982024-11-06T00:21:25.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47992024-11-06T00:21:25.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48002024-11-06T00:21:25.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48012024-11-06T00:21:25.939ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
48022024-11-06T00:21:25.939ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
48032024-11-06T00:21:25.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48042024-11-06T00:21:25.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48052024-11-06T00:21:25.939ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
48062024-11-06T00:21:25.939ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
48072024-11-06T00:21:25.939ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-06 00:19:32.804378 UTC dns_group = internal generation = 1
48082024-11-06T00:21:25.939ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 133.276337ms iteration = 4 status = {"generation":1}
48092024-11-06T00:21:25.940ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48102024-11-06T00:21:25.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48112024-11-06T00:21:25.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48122024-11-06T00:21:25.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48132024-11-06T00:21:25.943ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48142024-11-06T00:21:25.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48152024-11-06T00:21:25.947ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
48162024-11-06T00:21:25.947ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
48172024-11-06T00:21:25.947ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-06 00:19:33.391850 UTC dns_group = external generation = 2
48182024-11-06T00:21:25.947ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 141.608134ms iteration = 4 status = {"generation":2}
48192024-11-06T00:21:25.975ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
48202024-11-06T00:21:25.975ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48212024-11-06T00:21:25.975ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8cc2a44-7d1b-480f-90c2-51c98ce7cdaf", "content-length": "26", "date": "Wed, 06 Nov 2024 00:21:25 GMT"} })
48222024-11-06T00:21:25.975ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48232024-11-06T00:21:25.977ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
48242024-11-06T00:21:25.986ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-06T00:19:22.736570Z, time_modified: 2024-11-06T00:19:22.736570Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
48252024-11-06T00:21:25.986ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 180.54508ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]}},"default_endpoint":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
48262024-11-06T00:21:25.987ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
48272024-11-06T00:21:26.010ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 204.331667ms iteration = 7 status = {"physical_disks_added":0}
48282024-11-06T00:21:26.012ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
48292024-11-06T00:21:26.012ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48302024-11-06T00:21:26.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48312024-11-06T00:21:26.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48322024-11-06T00:21:26.012ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "468c769c-c9da-4bce-8ee2-58e73b1053a3", "content-length": "26", "date": "Wed, 06 Nov 2024 00:21:25 GMT"} })
48332024-11-06T00:21:26.012ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48342024-11-06T00:21:26.013ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
48352024-11-06T00:21:26.013ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 207.419998ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
48362024-11-06T00:21:26.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48372024-11-06T00:21:26.014ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48382024-11-06T00:21:26.016ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48392024-11-06T00:21:26.016ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48402024-11-06T00:21:26.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48412024-11-06T00:21:26.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48422024-11-06T00:21:26.019ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48432024-11-06T00:21:26.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48442024-11-06T00:21:26.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48452024-11-06T00:21:26.074ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
48462024-11-06T00:21:26.117ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
48472024-11-06T00:21:26.117ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48482024-11-06T00:21:26.118ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "86ff2e45-18ae-4d36-b13b-33a961143e56", "content-length": "26", "date": "Wed, 06 Nov 2024 00:21:25 GMT"} })
48492024-11-06T00:21:26.118ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48502024-11-06T00:21:26.119ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48512024-11-06T00:21:26.174ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48522024-11-06T00:21:26.174ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48532024-11-06T00:21:26.174ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5dcb673f-7437-4549-a93a-c78474c46cc4", "content-length": "372", "date": "Wed, 06 Nov 2024 00:21:25 GMT"} })
48542024-11-06T00:21:26.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48552024-11-06T00:21:26.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48562024-11-06T00:21:26.188ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
48572024-11-06T00:21:26.188ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
48582024-11-06T00:21:26.188ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "59c6f445-cecb-4ce5-969a-5fcc3fc5b03d", "date": "Wed, 06 Nov 2024 00:21:25 GMT"} })
48592024-11-06T00:21:26.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48602024-11-06T00:21:26.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48612024-11-06T00:21:26.191ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48622024-11-06T00:21:26.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48632024-11-06T00:21:26.195ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48642024-11-06T00:21:26.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48652024-11-06T00:21:26.199ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48662024-11-06T00:21:26.199ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48672024-11-06T00:21:26.199ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "de141726-51c5-4092-bbc6-43365f6c3b43", "date": "Wed, 06 Nov 2024 00:21:25 GMT"} })
48682024-11-06T00:21:26.201ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 395.08681ms iteration = 6 status = {}
48692024-11-06T00:21:26.218ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48702024-11-06T00:21:26.218ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "377b3e4d-360a-4e8f-8c08-6abd99e7bc8d", "content-length": "1", "date": "Wed, 06 Nov 2024 00:21:26 GMT"} })
48712024-11-06T00:21:26.219ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48722024-11-06T00:21:26.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48732024-11-06T00:21:26.259ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
48742024-11-06T00:21:26.260ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0bf2fc86-8370-453e-93e3-73ba1915d80d", "date": "Wed, 06 Nov 2024 00:21:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48752024-11-06T00:21:26.260ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48762024-11-06T00:21:26.261ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "56e8729e-07fb-49f4-889d-2d5cb01048c4", "date": "Wed, 06 Nov 2024 00:21:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48772024-11-06T00:21:26.261ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48782024-11-06T00:21:26.262ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48792024-11-06T00:21:26.262ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 456.261816ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
48802024-11-06T00:21:26.298ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
48812024-11-06T00:21:26.298ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "867f8198-b154-4ba1-ae02-643c45a2bcc5", "content-length": "691", "date": "Wed, 06 Nov 2024 00:21:25 GMT"} })
48822024-11-06T00:21:26.298ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
48832024-11-06T00:21:26.298ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
48842024-11-06T00:21:26.298ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
48852024-11-06T00:21:26.299ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 493.621485ms iteration = 5 status = {}
48862024-11-06T00:21:26.300ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 494.094809ms iteration = 5 status = null
48872024-11-06T00:21:26.311ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
48882024-11-06T00:21:26.335ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 529.204651ms iteration = 5 status = {}
48892024-11-06T00:21:26.458ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
48902024-11-06T00:21:26.459ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "bb38c922-67f8-4abc-8592-7975f3a34f4a", "date": "Wed, 06 Nov 2024 00:21:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48912024-11-06T00:21:26.459ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48922024-11-06T00:21:26.460ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4a60648d-2d61-4d25-acf4-5b73c10021d1", "date": "Wed, 06 Nov 2024 00:21:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48932024-11-06T00:21:26.460ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48942024-11-06T00:21:26.462ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "db876f8f-fd1a-4d14-a9c7-6035e95065ab", "date": "Wed, 06 Nov 2024 00:21:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48952024-11-06T00:21:26.462ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48962024-11-06T00:21:26.463ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48972024-11-06T00:21:26.463ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 657.122159ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
48982024-11-06T00:21:26.485ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48992024-11-06T00:21:26.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49002024-11-06T00:21:26.487ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
49012024-11-06T00:21:26.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49022024-11-06T00:21:26.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49032024-11-06T00:21:26.497ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
49042024-11-06T00:21:26.498ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "899a075f-2309-406b-93aa-b91b839fddea", "content-length": "121", "date": "Wed, 06 Nov 2024 00:21:26 GMT"} })
49052024-11-06T00:21:26.498ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
49062024-11-06T00:21:26.498ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
49072024-11-06T00:21:26.498ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
49082024-11-06T00:21:26.498ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49092024-11-06T00:21:26.498ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49102024-11-06T00:21:26.498ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49112024-11-06T00:21:26.498ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49122024-11-06T00:21:26.498ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49132024-11-06T00:21:26.498ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49142024-11-06T00:21:26.498ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49152024-11-06T00:21:26.498ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
49162024-11-06T00:21:26.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49172024-11-06T00:21:26.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49182024-11-06T00:21:26.500ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
49192024-11-06T00:21:26.500ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb2dbf1e-e179-48f4-a651-084d615ec556", "content-length": "2", "date": "Wed, 06 Nov 2024 00:21:26 GMT"} })
49202024-11-06T00:21:26.500ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
49212024-11-06T00:21:26.500ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f989c381-81bc-4b47-b54b-1c1cb911bf01", "content-length": "52", "date": "Wed, 06 Nov 2024 00:21:26 GMT"} })
49222024-11-06T00:21:26.500ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
49232024-11-06T00:21:26.500ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
49242024-11-06T00:21:26.600ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a7b20271-5084-48dd-b97d-f884f47de2c0", "date": "Wed, 06 Nov 2024 00:21:25 GMT"} })
49252024-11-06T00:21:26.600ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
49262024-11-06T00:21:26.600ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49272024-11-06T00:21:26.600ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2e2dfeb-ed09-4d9a-8c33-3b771b73d5dc", "content-length": "669", "date": "Wed, 06 Nov 2024 00:21:25 GMT"} })
49282024-11-06T00:21:26.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49292024-11-06T00:21:26.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49302024-11-06T00:21:26.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49312024-11-06T00:21:26.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49322024-11-06T00:21:26.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49332024-11-06T00:21:26.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49342024-11-06T00:21:26.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49352024-11-06T00:21:26.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49362024-11-06T00:21:26.617ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 811.427471ms iteration = 5 status = {}
49372024-11-06T00:21:28.941ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45112
49382024-11-06T00:21:28.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45112 req_id = 94c80f23-16b6-462a-a6fa-074de193ed93 roles = RoleSet { roles: {} } uri = /metrics/producers
49392024-11-06T00:21:28.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45112 req_id = 94c80f23-16b6-462a-a6fa-074de193ed93 resource = Database result = Ok(()) uri = /metrics/producers
49402024-11-06T00:21:28.979ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = fed3ec74-af42-4df7-9f71-3957f7103dff
49412024-11-06T00:21:28.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35816 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45112 req_id = 94c80f23-16b6-462a-a6fa-074de193ed93 response_code = 201 uri = /metrics/producers
49422024-11-06T00:21:31.477ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1529 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 8526d2d5-b64e-4449-8a87-174ccc77640b response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
49432024-11-06T00:21:35.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
49442024-11-06T00:21:35.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
49452024-11-06T00:21:35.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49462024-11-06T00:21:35.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49472024-11-06T00:21:35.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49482024-11-06T00:21:35.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49492024-11-06T00:21:35.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49502024-11-06T00:21:35.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49512024-11-06T00:21:35.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49522024-11-06T00:21:35.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.982748ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49532024-11-06T00:21:35.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49542024-11-06T00:21:35.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49552024-11-06T00:21:35.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49562024-11-06T00:21:35.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49572024-11-06T00:21:35.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49582024-11-06T00:21:35.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49592024-11-06T00:21:35.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
49602024-11-06T00:21:35.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49612024-11-06T00:21:35.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49622024-11-06T00:21:35.823ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
49632024-11-06T00:21:35.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.491659ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
49642024-11-06T00:21:36.468ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:53594
49652024-11-06T00:21:36.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 46b56575-1b27-4019-a85c-71e63ff0487e roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
49662024-11-06T00:21:36.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 46b56575-1b27-4019-a85c-71e63ff0487e resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
49672024-11-06T00:21:36.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3806 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 46b56575-1b27-4019-a85c-71e63ff0487e response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
49682024-11-06T00:21:36.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 0d4ee8e9-d128-4f7d-940b-652ec8f8b7e2 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
49692024-11-06T00:21:36.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 0d4ee8e9-d128-4f7d-940b-652ec8f8b7e2 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
49702024-11-06T00:21:36.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 0d4ee8e9-d128-4f7d-940b-652ec8f8b7e2 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
49712024-11-06T00:21:45.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
49722024-11-06T00:21:45.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
49732024-11-06T00:21:45.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49742024-11-06T00:21:45.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49752024-11-06T00:21:45.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49762024-11-06T00:21:45.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49772024-11-06T00:21:45.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49782024-11-06T00:21:45.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49792024-11-06T00:21:45.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49802024-11-06T00:21:45.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.957957ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49812024-11-06T00:21:45.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49822024-11-06T00:21:45.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49832024-11-06T00:21:45.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49842024-11-06T00:21:45.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49852024-11-06T00:21:45.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49862024-11-06T00:21:45.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49872024-11-06T00:21:45.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
49882024-11-06T00:21:45.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49892024-11-06T00:21:45.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49902024-11-06T00:21:45.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
49912024-11-06T00:21:45.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 118.694744ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
49922024-11-06T00:21:46.476ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1073 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 39f6cb77-313f-4be5-a8df-bb2db9fa52c5 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
49932024-11-06T00:21:55.138ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:41185
49942024-11-06T00:21:55.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41185 req_id = 7a1e4292-5352-4a00-87b3-7049b814741d roles = RoleSet { roles: {} } uri = /metrics/producers
49952024-11-06T00:21:55.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41185 req_id = 7a1e4292-5352-4a00-87b3-7049b814741d resource = Database result = Ok(()) uri = /metrics/producers
49962024-11-06T00:21:55.150ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = a6ef5eb9-ed97-44f5-b038-ae216d3973fd
49972024-11-06T00:21:55.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11799 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41185 req_id = 7a1e4292-5352-4a00-87b3-7049b814741d response_code = 201 uri = /metrics/producers
49982024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
49992024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
50002024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50012024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
50022024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50032024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50042024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
50052024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50062024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
50072024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
50082024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50092024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
50102024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50112024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
50122024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
50132024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.15\u{b5}s iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50142024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
50152024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
50162024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.33\u{b5}s iteration = 6 status = {"errors":[],"records_set_to_done":[]}
50172024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50182024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
50192024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50202024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
50212024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.511\u{b5}s iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
50222024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
50232024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.801\u{b5}s iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
50242024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
50252024-11-06T00:21:55.806ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50262024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50272024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
50282024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50292024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50302024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50312024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
50322024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50332024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50342024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50352024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50362024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50372024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50382024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50392024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50402024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50412024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50422024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50432024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50442024-11-06T00:21:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50452024-11-06T00:21:55.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50462024-11-06T00:21:55.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50472024-11-06T00:21:55.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50482024-11-06T00:21:55.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50492024-11-06T00:21:55.809ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.724201ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
50502024-11-06T00:21:55.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50512024-11-06T00:21:55.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50522024-11-06T00:21:55.811ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1179, tv_nsec: 150913285 } })
50532024-11-06T00:21:55.811ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
50542024-11-06T00:21:55.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50552024-11-06T00:21:55.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50562024-11-06T00:21:55.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50572024-11-06T00:21:55.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
50582024-11-06T00:21:55.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50592024-11-06T00:21:55.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50602024-11-06T00:21:55.813ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50612024-11-06T00:21:55.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50622024-11-06T00:21:55.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50632024-11-06T00:21:55.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50642024-11-06T00:21:55.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50652024-11-06T00:21:55.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50662024-11-06T00:21:55.817ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50672024-11-06T00:21:55.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50682024-11-06T00:21:55.819ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1179, tv_nsec: 158901122 } })
50692024-11-06T00:21:55.819ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.13587ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50702024-11-06T00:21:55.819ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
50712024-11-06T00:21:55.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50722024-11-06T00:21:55.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50732024-11-06T00:21:55.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50742024-11-06T00:21:55.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50752024-11-06T00:21:55.820ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50762024-11-06T00:21:55.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50772024-11-06T00:21:55.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50782024-11-06T00:21:55.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50792024-11-06T00:21:55.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50802024-11-06T00:21:55.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50812024-11-06T00:21:55.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50822024-11-06T00:21:55.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50832024-11-06T00:21:55.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50842024-11-06T00:21:55.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50852024-11-06T00:21:55.824ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1179, tv_nsec: 164333673 } })
50862024-11-06T00:21:55.824ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
50872024-11-06T00:21:55.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50882024-11-06T00:21:55.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50892024-11-06T00:21:55.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50902024-11-06T00:21:55.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
50912024-11-06T00:21:55.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50922024-11-06T00:21:55.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50932024-11-06T00:21:55.826ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50942024-11-06T00:21:55.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50952024-11-06T00:21:55.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50962024-11-06T00:21:55.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50972024-11-06T00:21:55.852ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50982024-11-06T00:21:55.852ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50992024-11-06T00:21:55.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51002024-11-06T00:21:55.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51012024-11-06T00:21:55.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51022024-11-06T00:21:55.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51032024-11-06T00:21:55.862ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51042024-11-06T00:21:55.862ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.660162ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51052024-11-06T00:21:55.906ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
51062024-11-06T00:21:55.906ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51072024-11-06T00:21:55.907ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "65473cc1-402f-41dd-a164-7bc26877c473", "content-length": "26", "date": "Wed, 06 Nov 2024 00:21:55 GMT"} })
51082024-11-06T00:21:55.907ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51092024-11-06T00:21:55.908ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51102024-11-06T00:21:55.927ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
51112024-11-06T00:21:55.927ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51122024-11-06T00:21:55.927ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fa56e5f-70ef-4d82-a739-4324f4771e1d", "content-length": "26", "date": "Wed, 06 Nov 2024 00:21:55 GMT"} })
51132024-11-06T00:21:55.927ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51142024-11-06T00:21:55.929ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51152024-11-06T00:21:55.934ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 128.35501ms iteration = 8 status = {"physical_disks_added":0}
51162024-11-06T00:21:55.936ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
51172024-11-06T00:21:55.936ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51182024-11-06T00:21:55.936ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb9079ef-b64e-4c5a-8598-9b81ef69e8a4", "content-length": "26", "date": "Wed, 06 Nov 2024 00:21:55 GMT"} })
51192024-11-06T00:21:55.936ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51202024-11-06T00:21:55.937ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
51212024-11-06T00:21:55.940ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51222024-11-06T00:21:55.940ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51232024-11-06T00:21:55.941ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "acc591d4-5392-4f0f-9cfb-47b1d9b69631", "content-length": "372", "date": "Wed, 06 Nov 2024 00:21:55 GMT"} })
51242024-11-06T00:21:55.941ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51252024-11-06T00:21:55.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51262024-11-06T00:21:55.943ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
51272024-11-06T00:21:55.943ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 137.789481ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
51282024-11-06T00:21:55.944ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51292024-11-06T00:21:55.944ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
51302024-11-06T00:21:55.944ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51312024-11-06T00:21:55.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51322024-11-06T00:21:55.947ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51332024-11-06T00:21:55.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51342024-11-06T00:21:55.959ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51352024-11-06T00:21:55.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51362024-11-06T00:21:55.963ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51372024-11-06T00:21:55.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51382024-11-06T00:21:55.986ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 179.783168ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51392024-11-06T00:21:55.987ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51402024-11-06T00:21:55.987ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51412024-11-06T00:21:55.987ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 181.569141ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
51422024-11-06T00:21:55.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51432024-11-06T00:21:55.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51442024-11-06T00:21:55.992ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51452024-11-06T00:21:55.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
51462024-11-06T00:21:55.994ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51472024-11-06T00:21:55.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51482024-11-06T00:21:55.997ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 190.97504ms iteration = 6 status = 0
51492024-11-06T00:21:55.997ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
51502024-11-06T00:21:55.997ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51512024-11-06T00:21:55.997ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ae867848-c42d-4daf-aa56-ba91236e3da2", "date": "Wed, 06 Nov 2024 00:21:55 GMT"} })
51522024-11-06T00:21:55.997ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51532024-11-06T00:21:55.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51542024-11-06T00:21:56.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51552024-11-06T00:21:56.002ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 196.653698ms iteration = 6 status = {}
51562024-11-06T00:21:56.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51572024-11-06T00:21:56.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51582024-11-06T00:21:56.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51592024-11-06T00:21:56.009ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51602024-11-06T00:21:56.009ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51612024-11-06T00:21:56.009ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e38e698b-d223-40ea-b8fa-fc27c8f9513b", "date": "Wed, 06 Nov 2024 00:21:55 GMT"} })
51622024-11-06T00:21:56.010ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 204.224223ms iteration = 7 status = {}
51632024-11-06T00:21:56.011ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
51642024-11-06T00:21:56.011ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "12f2e9ea-374f-40f6-a4a0-b0901b09273a", "content-length": "1", "date": "Wed, 06 Nov 2024 00:21:55 GMT"} })
51652024-11-06T00:21:56.012ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51662024-11-06T00:21:56.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51672024-11-06T00:21:56.015ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 208.82003ms iteration = 6 status = null
51682024-11-06T00:21:56.025ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51692024-11-06T00:21:56.027ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51702024-11-06T00:21:56.027ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51712024-11-06T00:21:56.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51722024-11-06T00:21:56.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51732024-11-06T00:21:56.030ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51742024-11-06T00:21:56.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51752024-11-06T00:21:56.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51762024-11-06T00:21:56.095ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51772024-11-06T00:21:56.095ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c7bdf53-f8ed-4990-882e-cd2c3926f508", "content-length": "691", "date": "Wed, 06 Nov 2024 00:21:55 GMT"} })
51782024-11-06T00:21:56.095ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
51792024-11-06T00:21:56.095ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
51802024-11-06T00:21:56.095ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
51812024-11-06T00:21:56.096ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 290.00797ms iteration = 6 status = {}
51822024-11-06T00:21:56.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51832024-11-06T00:21:56.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51842024-11-06T00:21:56.110ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
51852024-11-06T00:21:56.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51862024-11-06T00:21:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51872024-11-06T00:21:56.119ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
51882024-11-06T00:21:56.119ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b3c1eb4-b52a-4bac-abbe-5e4b3e0c9c1c", "content-length": "121", "date": "Wed, 06 Nov 2024 00:21:55 GMT"} })
51892024-11-06T00:21:56.119ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
51902024-11-06T00:21:56.119ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
51912024-11-06T00:21:56.119ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
51922024-11-06T00:21:56.119ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51932024-11-06T00:21:56.119ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51942024-11-06T00:21:56.119ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51952024-11-06T00:21:56.119ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51962024-11-06T00:21:56.119ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51972024-11-06T00:21:56.120ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51982024-11-06T00:21:56.120ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51992024-11-06T00:21:56.120ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
52002024-11-06T00:21:56.120ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52012024-11-06T00:21:56.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52022024-11-06T00:21:56.122ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
52032024-11-06T00:21:56.122ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "558f9645-2934-4a3a-98af-651b3a1c408c", "content-length": "2", "date": "Wed, 06 Nov 2024 00:21:55 GMT"} })
52042024-11-06T00:21:56.122ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
52052024-11-06T00:21:56.123ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c266223a-86d3-4358-8ba4-f2cd3162dd9e", "content-length": "52", "date": "Wed, 06 Nov 2024 00:21:55 GMT"} })
52062024-11-06T00:21:56.123ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
52072024-11-06T00:21:56.123ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52082024-11-06T00:21:56.224ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e8416e8b-07c1-41ad-b2dd-3d6511c5f997", "date": "Wed, 06 Nov 2024 00:21:55 GMT"} })
52092024-11-06T00:21:56.224ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
52102024-11-06T00:21:56.224ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52112024-11-06T00:21:56.229ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "79078c3c-ad7c-4d05-9987-500bed885af5", "content-length": "669", "date": "Wed, 06 Nov 2024 00:21:56 GMT"} })
52122024-11-06T00:21:56.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52132024-11-06T00:21:56.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52142024-11-06T00:21:56.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52152024-11-06T00:21:56.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52162024-11-06T00:21:56.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52172024-11-06T00:21:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52182024-11-06T00:21:56.362ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52192024-11-06T00:21:56.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52202024-11-06T00:21:56.379ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 573.031213ms iteration = 6 status = {}
52212024-11-06T00:22:01.475ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1421 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 7a316305-eb52-4a3c-89af-e61200790987 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
52222024-11-06T00:22:04.595ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
52232024-11-06T00:22:04.595ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
52242024-11-06T00:22:04.625ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
52252024-11-06T00:22:04.625ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:36342
52262024-11-06T00:22:04.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36342 req_id = 13fd1d9c-eb39-4090-89bb-ee050179d394 roles = RoleSet { roles: {} } uri = /metrics/producers
52272024-11-06T00:22:04.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36342 req_id = 13fd1d9c-eb39-4090-89bb-ee050179d394 resource = Database result = Ok(()) uri = /metrics/producers
52282024-11-06T00:22:04.766ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = e2378399-e8ed-453c-847a-0a419dfd0966
52292024-11-06T00:22:04.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140710 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36342 req_id = 13fd1d9c-eb39-4090-89bb-ee050179d394 response_code = 201 uri = /metrics/producers
52302024-11-06T00:22:04.766ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "13fd1d9c-eb39-4090-89bb-ee050179d394", "content-length": "41", "date": "Wed, 06 Nov 2024 00:22:04 GMT"} })
52312024-11-06T00:22:04.768ZDEBGnexus (producer-registration-task): registered with nexus successfully
52322024-11-06T00:22:04.768ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
52332024-11-06T00:22:05.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
52342024-11-06T00:22:05.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52352024-11-06T00:22:05.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
52362024-11-06T00:22:05.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52372024-11-06T00:22:05.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52382024-11-06T00:22:05.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52392024-11-06T00:22:05.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52402024-11-06T00:22:05.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52412024-11-06T00:22:05.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52422024-11-06T00:22:05.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.667219ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52432024-11-06T00:22:05.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52442024-11-06T00:22:05.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52452024-11-06T00:22:05.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52462024-11-06T00:22:05.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52472024-11-06T00:22:05.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52482024-11-06T00:22:05.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52492024-11-06T00:22:05.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
52502024-11-06T00:22:05.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52512024-11-06T00:22:05.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52522024-11-06T00:22:05.826ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
52532024-11-06T00:22:05.827ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.344753ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
52542024-11-06T00:22:15.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
52552024-11-06T00:22:15.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
52562024-11-06T00:22:15.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52572024-11-06T00:22:15.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52582024-11-06T00:22:15.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52592024-11-06T00:22:15.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52602024-11-06T00:22:15.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52612024-11-06T00:22:15.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52622024-11-06T00:22:15.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52632024-11-06T00:22:15.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.009889ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52642024-11-06T00:22:15.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52652024-11-06T00:22:15.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52662024-11-06T00:22:15.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52672024-11-06T00:22:15.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52682024-11-06T00:22:15.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52692024-11-06T00:22:15.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52702024-11-06T00:22:15.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
52712024-11-06T00:22:15.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52722024-11-06T00:22:15.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52732024-11-06T00:22:15.827ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
52742024-11-06T00:22:15.827ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.700894ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
52752024-11-06T00:22:16.475ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1107 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = ee053879-dcd7-4a78-9c4d-808037d406d7 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
52762024-11-06T00:22:18.646ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:58847
52772024-11-06T00:22:18.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58847 req_id = 1b05c517-c018-4f80-8d76-ac7415c79247 roles = RoleSet { roles: {} } uri = /metrics/producers
52782024-11-06T00:22:18.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58847 req_id = 1b05c517-c018-4f80-8d76-ac7415c79247 resource = Database result = Ok(()) uri = /metrics/producers
52792024-11-06T00:22:18.657ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = 57aed6c0-b7d9-4021-84f4-804ca56d1b7a
52802024-11-06T00:22:18.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11198 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58847 req_id = 1b05c517-c018-4f80-8d76-ac7415c79247 response_code = 201 uri = /metrics/producers
52812024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
52822024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52832024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
52842024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
52852024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
52862024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
52872024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52882024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
52892024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
52902024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52912024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52922024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
52932024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52942024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
52952024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52962024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
52972024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
52982024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.161\u{b5}s iteration = 7 status = {"errors":[],"records_set_to_done":[]}
52992024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
53002024-11-06T00:22:25.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
53012024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53022024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
53032024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.97\u{b5}s iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
53042024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53052024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
53062024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
53072024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
53082024-11-06T00:22:25.806ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846
53092024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
53102024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.16\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846"}
53112024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
53122024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
53132024-11-06T00:22:25.806ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
53142024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
53152024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53162024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53172024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
53182024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53192024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
53202024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
53212024-11-06T00:22:25.806ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-06 00:12:25.805988792 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
53222024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
53232024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
53242024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53252024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
53262024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
53272024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
53282024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53292024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
53302024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53312024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
53322024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53332024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
53342024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
53352024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53362024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.9\u{b5}s iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
53372024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53382024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
53392024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
53402024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53412024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.96\u{b5}s iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
53422024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
53432024-11-06T00:22:25.806ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53442024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53452024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53462024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53472024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53482024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
53492024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53502024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53512024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53522024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53532024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53542024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53552024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53562024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53572024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
53582024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
53592024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53602024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53612024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53622024-11-06T00:22:25.806ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("309c9aef-da72-4f08-9f70-c20d80316472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1209, tv_nsec: 146775242 } })
53632024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53642024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53652024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53662024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53672024-11-06T00:22:25.806ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51df9631-cef5-49ae-8cfd-f0c05bdac388.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7102227a-61f8-4dda-a9a0-f6678fae71c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1209, tv_nsec: 146816573 } })
53682024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53692024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53702024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53712024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53722024-11-06T00:22:25.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53732024-11-06T00:22:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53742024-11-06T00:22:25.807ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53752024-11-06T00:22:25.807ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
53762024-11-06T00:22:25.807ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.200715ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
53772024-11-06T00:22:25.807ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
53782024-11-06T00:22:25.807ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.277658ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
53792024-11-06T00:22:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53802024-11-06T00:22:25.809ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53812024-11-06T00:22:25.810ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1209, tv_nsec: 150812832 } })
53822024-11-06T00:22:25.810ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.664089ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53832024-11-06T00:22:25.810ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
53842024-11-06T00:22:25.811ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.828673ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
53852024-11-06T00:22:25.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1209, tv_nsec: 152183293 } })
53862024-11-06T00:22:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53872024-11-06T00:22:25.812ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53882024-11-06T00:22:25.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
53892024-11-06T00:22:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53902024-11-06T00:22:25.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53912024-11-06T00:22:25.814ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53922024-11-06T00:22:25.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53932024-11-06T00:22:25.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53942024-11-06T00:22:25.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53952024-11-06T00:22:25.815ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53962024-11-06T00:22:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53972024-11-06T00:22:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53982024-11-06T00:22:25.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53992024-11-06T00:22:25.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54002024-11-06T00:22:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54012024-11-06T00:22:25.818ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54022024-11-06T00:22:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54032024-11-06T00:22:25.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54042024-11-06T00:22:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54052024-11-06T00:22:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54062024-11-06T00:22:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54072024-11-06T00:22:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54082024-11-06T00:22:25.820ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-06 00:12:25.805988792 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
54092024-11-06T00:22:25.820ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.398198ms iteration = 4 status = {"expiration":"2024-11-06T00:12:25.805988792Z","pruned":[]}
54102024-11-06T00:22:25.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54112024-11-06T00:22:25.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54122024-11-06T00:22:25.821ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54132024-11-06T00:22:25.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54142024-11-06T00:22:25.822ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
54152024-11-06T00:22:25.822ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
54162024-11-06T00:22:25.822ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.401147ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
54172024-11-06T00:22:25.822ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54182024-11-06T00:22:25.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54192024-11-06T00:22:25.824ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54202024-11-06T00:22:25.824ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54212024-11-06T00:22:25.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54222024-11-06T00:22:25.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54232024-11-06T00:22:25.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54242024-11-06T00:22:25.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54252024-11-06T00:22:25.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54262024-11-06T00:22:25.828ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54272024-11-06T00:22:25.828ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54282024-11-06T00:22:25.828ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54292024-11-06T00:22:25.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54302024-11-06T00:22:25.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54312024-11-06T00:22:25.830ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54322024-11-06T00:22:25.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54332024-11-06T00:22:25.831ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54342024-11-06T00:22:25.833ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54352024-11-06T00:22:25.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54362024-11-06T00:22:25.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54372024-11-06T00:22:25.834ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54382024-11-06T00:22:25.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54392024-11-06T00:22:25.835ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54402024-11-06T00:22:25.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54412024-11-06T00:22:25.837ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54422024-11-06T00:22:25.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54432024-11-06T00:22:25.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54442024-11-06T00:22:25.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54452024-11-06T00:22:25.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54462024-11-06T00:22:25.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54472024-11-06T00:22:25.842ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54482024-11-06T00:22:25.842ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1209, tv_nsec: 182966126 } })
54492024-11-06T00:22:25.843ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
54502024-11-06T00:22:25.844ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54512024-11-06T00:22:25.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54522024-11-06T00:22:25.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54532024-11-06T00:22:25.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54542024-11-06T00:22:25.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54552024-11-06T00:22:25.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54562024-11-06T00:22:25.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54572024-11-06T00:22:25.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54582024-11-06T00:22:25.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54592024-11-06T00:22:25.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54602024-11-06T00:22:25.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
54612024-11-06T00:22:25.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54622024-11-06T00:22:25.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54632024-11-06T00:22:25.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54642024-11-06T00:22:25.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.553049ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54652024-11-06T00:22:25.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54662024-11-06T00:22:25.865ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54672024-11-06T00:22:25.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54682024-11-06T00:22:25.871ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54692024-11-06T00:22:25.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54702024-11-06T00:22:25.873ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54712024-11-06T00:22:25.873ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54722024-11-06T00:22:25.873ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54732024-11-06T00:22:25.873ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54742024-11-06T00:22:25.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54752024-11-06T00:22:25.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54762024-11-06T00:22:25.875ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54772024-11-06T00:22:25.875ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54782024-11-06T00:22:25.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54792024-11-06T00:22:25.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
54802024-11-06T00:22:25.876ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54812024-11-06T00:22:25.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54822024-11-06T00:22:25.878ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54832024-11-06T00:22:25.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54842024-11-06T00:22:25.879ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54852024-11-06T00:22:25.879ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54862024-11-06T00:22:25.879ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54872024-11-06T00:22:25.879ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54882024-11-06T00:22:25.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54892024-11-06T00:22:25.880ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.027348ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54902024-11-06T00:22:25.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54912024-11-06T00:22:25.882ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54922024-11-06T00:22:25.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54932024-11-06T00:22:25.883ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
54942024-11-06T00:22:25.883ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.686547ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
54952024-11-06T00:22:25.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54962024-11-06T00:22:25.884ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 78.222193ms iteration = 3 status = {"nsuccess":5}
54972024-11-06T00:22:25.885ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54982024-11-06T00:22:25.885ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54992024-11-06T00:22:25.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55002024-11-06T00:22:25.889ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-06T00:19:22.736570Z, time_modified: 2024-11-06T00:19:22.736570Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }) }
55012024-11-06T00:22:25.889ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 83.406016ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]}},"default_endpoint":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
55022024-11-06T00:22:25.892ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
55032024-11-06T00:22:25.892ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
55042024-11-06T00:22:25.892ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
55052024-11-06T00:22:25.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55062024-11-06T00:22:25.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55072024-11-06T00:22:25.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55082024-11-06T00:22:25.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55092024-11-06T00:22:25.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55102024-11-06T00:22:25.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55112024-11-06T00:22:25.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55122024-11-06T00:22:25.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55132024-11-06T00:22:25.906ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55142024-11-06T00:22:25.906ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 100.522774ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55152024-11-06T00:22:25.910ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
55162024-11-06T00:22:25.910ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
55172024-11-06T00:22:25.910ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 104.227865ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
55182024-11-06T00:22:25.918ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55192024-11-06T00:22:25.918ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55202024-11-06T00:22:25.918ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 112.433598ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55212024-11-06T00:22:25.927ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
55222024-11-06T00:22:25.931ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
55232024-11-06T00:22:25.934ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
55242024-11-06T00:22:25.934ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55252024-11-06T00:22:25.934ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a66f6dc-1160-4b58-8a93-e83c7c254a7b", "content-length": "26", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} })
55262024-11-06T00:22:25.934ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55272024-11-06T00:22:25.935ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
55282024-11-06T00:22:25.935ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55292024-11-06T00:22:25.936ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "937e97f4-0399-4cf9-a8d3-c225e4a1864f", "content-length": "26", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} })
55302024-11-06T00:22:25.936ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55312024-11-06T00:22:25.939ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55322024-11-06T00:22:25.940ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55332024-11-06T00:22:25.944ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
55342024-11-06T00:22:25.944ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
55352024-11-06T00:22:25.944ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
55362024-11-06T00:22:25.944ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55372024-11-06T00:22:25.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55382024-11-06T00:22:25.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55392024-11-06T00:22:25.948ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
55402024-11-06T00:22:25.948ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
55412024-11-06T00:22:25.948ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55422024-11-06T00:22:25.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55432024-11-06T00:22:25.950ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55442024-11-06T00:22:25.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55452024-11-06T00:22:25.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55462024-11-06T00:22:25.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55472024-11-06T00:22:25.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55482024-11-06T00:22:25.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55492024-11-06T00:22:25.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55502024-11-06T00:22:25.960ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
55512024-11-06T00:22:25.960ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
55522024-11-06T00:22:25.960ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-06 00:19:32.804378 UTC dns_group = internal generation = 1
55532024-11-06T00:22:25.960ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 154.469027ms iteration = 5 status = {"generation":1}
55542024-11-06T00:22:25.960ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
55552024-11-06T00:22:25.960ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
55562024-11-06T00:22:25.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55572024-11-06T00:22:25.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55582024-11-06T00:22:25.962ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55592024-11-06T00:22:25.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55602024-11-06T00:22:25.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55612024-11-06T00:22:25.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55622024-11-06T00:22:25.968ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
55632024-11-06T00:22:25.968ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
55642024-11-06T00:22:25.968ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-06 00:19:33.391850 UTC dns_group = external generation = 2
55652024-11-06T00:22:25.968ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 162.448773ms iteration = 5 status = {"generation":2}
55662024-11-06T00:22:25.979ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
55672024-11-06T00:22:25.979ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55682024-11-06T00:22:25.980ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "01d464bd-0a39-4855-a335-c76b4d8774c3", "content-length": "26", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} })
55692024-11-06T00:22:25.980ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55702024-11-06T00:22:25.981ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
55712024-11-06T00:22:25.987ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
55722024-11-06T00:22:25.987ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 181.712675ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
55732024-11-06T00:22:25.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55742024-11-06T00:22:25.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55752024-11-06T00:22:25.996ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 191.147755ms iteration = 9 status = {"physical_disks_added":0}
55762024-11-06T00:22:26.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55772024-11-06T00:22:26.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55782024-11-06T00:22:26.089ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55792024-11-06T00:22:26.089ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f0f44ad-5afd-4d8d-a84c-5ba3f09df29e", "content-length": "1", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} })
55802024-11-06T00:22:26.091ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55812024-11-06T00:22:26.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55822024-11-06T00:22:26.103ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
55832024-11-06T00:22:26.103ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ccb684d9-e978-4a32-86d4-c52d3ca27efc", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55842024-11-06T00:22:26.103ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55852024-11-06T00:22:26.104ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
55862024-11-06T00:22:26.105ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3288ec9c-a5b4-4140-b5fe-1d7b1c6219d7", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55872024-11-06T00:22:26.105ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55882024-11-06T00:22:26.107ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55892024-11-06T00:22:26.107ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 301.820491ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
55902024-11-06T00:22:26.128ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55912024-11-06T00:22:26.128ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55922024-11-06T00:22:26.128ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1134e0e1-d937-4db2-a90f-039c431248e9", "content-length": "372", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} })
55932024-11-06T00:22:26.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55942024-11-06T00:22:26.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55952024-11-06T00:22:26.130ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55962024-11-06T00:22:26.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55972024-11-06T00:22:26.131ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 325.450302ms iteration = 7 status = null
55982024-11-06T00:22:26.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55992024-11-06T00:22:26.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
56002024-11-06T00:22:26.135ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56012024-11-06T00:22:26.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56022024-11-06T00:22:26.136ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56032024-11-06T00:22:26.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56042024-11-06T00:22:26.137ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 331.205343ms iteration = 7 status = 0
56052024-11-06T00:22:26.138ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56062024-11-06T00:22:26.140ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56072024-11-06T00:22:26.140ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56082024-11-06T00:22:26.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56092024-11-06T00:22:26.141ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56102024-11-06T00:22:26.143ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56112024-11-06T00:22:26.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56122024-11-06T00:22:26.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56132024-11-06T00:22:26.143ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
56142024-11-06T00:22:26.143ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
56152024-11-06T00:22:26.144ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1a4fcb87-7f49-4370-9083-f69f7cb0d17c", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} })
56162024-11-06T00:22:26.144ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56172024-11-06T00:22:26.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56182024-11-06T00:22:26.146ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56192024-11-06T00:22:26.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56202024-11-06T00:22:26.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56212024-11-06T00:22:26.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56222024-11-06T00:22:26.151ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56232024-11-06T00:22:26.151ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56242024-11-06T00:22:26.151ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6ed403cb-8ab1-41b4-95d4-bd1d569b0e53", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} })
56252024-11-06T00:22:26.153ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 347.213948ms iteration = 8 status = {}
56262024-11-06T00:22:26.172ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 366.913414ms iteration = 7 status = {}
56272024-11-06T00:22:26.206ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
56282024-11-06T00:22:26.206ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c6dec8ee-6437-4576-9da5-31783bc28f72", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56292024-11-06T00:22:26.206ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56302024-11-06T00:22:26.209ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "cda703da-0025-4ea7-bfc6-0c076ac04800", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56312024-11-06T00:22:26.209ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56322024-11-06T00:22:26.211ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d252676e-adb9-42fe-a448-503fe14e9bde", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56332024-11-06T00:22:26.211ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56342024-11-06T00:22:26.213ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56352024-11-06T00:22:26.213ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 407.746356ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
56362024-11-06T00:22:26.217ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56372024-11-06T00:22:26.217ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a346224a-86eb-41ad-863d-b08fbbdb165e", "content-length": "691", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} })
56382024-11-06T00:22:26.217ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
56392024-11-06T00:22:26.217ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
56402024-11-06T00:22:26.217ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
56412024-11-06T00:22:26.221ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 414.932479ms iteration = 7 status = {}
56422024-11-06T00:22:26.271ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56432024-11-06T00:22:26.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56442024-11-06T00:22:26.275ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
56452024-11-06T00:22:26.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56462024-11-06T00:22:26.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56472024-11-06T00:22:26.285ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56482024-11-06T00:22:26.286ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2488a2a-a52f-4754-9668-d7dd437f7083", "content-length": "121", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} })
56492024-11-06T00:22:26.286ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
56502024-11-06T00:22:26.286ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
56512024-11-06T00:22:26.286ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56522024-11-06T00:22:26.286ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56532024-11-06T00:22:26.286ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56542024-11-06T00:22:26.286ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56552024-11-06T00:22:26.286ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56562024-11-06T00:22:26.286ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56572024-11-06T00:22:26.287ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56582024-11-06T00:22:26.287ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56592024-11-06T00:22:26.287ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
56602024-11-06T00:22:26.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56612024-11-06T00:22:26.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56622024-11-06T00:22:26.290ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56632024-11-06T00:22:26.290ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ef73a31-dc32-4cd7-9724-40a5a3d57ea4", "content-length": "2", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} })
56642024-11-06T00:22:26.290ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56652024-11-06T00:22:26.290ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "780f7390-212c-4466-8697-05f54f94edad", "content-length": "52", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} })
56662024-11-06T00:22:26.290ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
56672024-11-06T00:22:26.290ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56682024-11-06T00:22:26.477ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8e9202bc-61fd-48b7-bb16-da3131f3d364", "date": "Wed, 06 Nov 2024 00:22:25 GMT"} })
56692024-11-06T00:22:26.477ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
56702024-11-06T00:22:26.477ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56712024-11-06T00:22:26.477ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fb8e454-e1c7-4a73-9246-432f907e6889", "content-length": "669", "date": "Wed, 06 Nov 2024 00:22:26 GMT"} })
56722024-11-06T00:22:26.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56732024-11-06T00:22:26.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56742024-11-06T00:22:26.481ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56752024-11-06T00:22:26.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56762024-11-06T00:22:26.485ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56772024-11-06T00:22:26.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56782024-11-06T00:22:26.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56792024-11-06T00:22:26.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56802024-11-06T00:22:26.495ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 689.47915ms iteration = 7 status = {}
56812024-11-06T00:22:31.475ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1163 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 956ff5aa-5910-4851-85ca-3aa9c405fe31 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
56822024-11-06T00:22:35.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
56832024-11-06T00:22:35.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56842024-11-06T00:22:35.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
56852024-11-06T00:22:35.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56862024-11-06T00:22:35.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56872024-11-06T00:22:35.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56882024-11-06T00:22:35.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56892024-11-06T00:22:35.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56902024-11-06T00:22:35.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56912024-11-06T00:22:35.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.399721ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56922024-11-06T00:22:35.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56932024-11-06T00:22:35.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56942024-11-06T00:22:35.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56952024-11-06T00:22:35.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56962024-11-06T00:22:35.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56972024-11-06T00:22:35.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56982024-11-06T00:22:35.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
56992024-11-06T00:22:35.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57002024-11-06T00:22:35.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57012024-11-06T00:22:35.826ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
57022024-11-06T00:22:35.826ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.877209ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
57032024-11-06T00:22:36.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = d3cec294-9c8b-4ee5-b8c1-8e54c6cbb7fa roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
57042024-11-06T00:22:36.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = d3cec294-9c8b-4ee5-b8c1-8e54c6cbb7fa resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
57052024-11-06T00:22:36.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = d3cec294-9c8b-4ee5-b8c1-8e54c6cbb7fa response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
57062024-11-06T00:22:36.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 46ac24e5-ebcd-4933-bd4e-b40d85364ae7 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
57072024-11-06T00:22:36.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 46ac24e5-ebcd-4933-bd4e-b40d85364ae7 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
57082024-11-06T00:22:36.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1802 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 46ac24e5-ebcd-4933-bd4e-b40d85364ae7 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
57092024-11-06T00:22:45.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
57102024-11-06T00:22:45.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57112024-11-06T00:22:45.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
57122024-11-06T00:22:45.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57132024-11-06T00:22:45.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57142024-11-06T00:22:45.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57152024-11-06T00:22:45.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57162024-11-06T00:22:45.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57172024-11-06T00:22:45.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57182024-11-06T00:22:45.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57192024-11-06T00:22:45.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57202024-11-06T00:22:45.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57212024-11-06T00:22:45.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57222024-11-06T00:22:45.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
57232024-11-06T00:22:45.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57242024-11-06T00:22:45.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57252024-11-06T00:22:45.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
57262024-11-06T00:22:45.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.385156ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
57272024-11-06T00:22:45.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57282024-11-06T00:22:45.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57292024-11-06T00:22:45.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.553847ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57302024-11-06T00:22:46.475ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1786 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 0d8a8215-21f1-4dd4-9229-6059ccc6df02 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
57312024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
57322024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57332024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
57342024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
57352024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.34\u{b5}s iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
57362024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
57372024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57382024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.74\u{b5}s iteration = 8 status = {"errors":[],"records_set_to_done":[]}
57392024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
57402024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
57412024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.68\u{b5}s iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
57422024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
57432024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57442024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.2\u{b5}s iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
57452024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
57462024-11-06T00:22:55.805ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57472024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
57482024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
57492024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57502024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57512024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57522024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
57532024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57542024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
57552024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57562024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57572024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
57582024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57592024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
57602024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
57612024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
57622024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57632024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57642024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
57652024-11-06T00:22:55.805ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57662024-11-06T00:22:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57672024-11-06T00:22:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57682024-11-06T00:22:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57692024-11-06T00:22:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57702024-11-06T00:22:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57712024-11-06T00:22:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57722024-11-06T00:22:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57732024-11-06T00:22:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57742024-11-06T00:22:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57752024-11-06T00:22:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57762024-11-06T00:22:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57772024-11-06T00:22:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57782024-11-06T00:22:55.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57792024-11-06T00:22:55.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57802024-11-06T00:22:55.808ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57812024-11-06T00:22:55.808ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.024399ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57822024-11-06T00:22:55.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57832024-11-06T00:22:55.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57842024-11-06T00:22:55.810ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57852024-11-06T00:22:55.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57862024-11-06T00:22:55.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57872024-11-06T00:22:55.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57882024-11-06T00:22:55.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57892024-11-06T00:22:55.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57902024-11-06T00:22:55.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57912024-11-06T00:22:55.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57922024-11-06T00:22:55.815ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1239, tv_nsec: 155634075 } })
57932024-11-06T00:22:55.815ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
57942024-11-06T00:22:55.815ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1239, tv_nsec: 156200532 } })
57952024-11-06T00:22:55.815ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
57962024-11-06T00:22:55.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57972024-11-06T00:22:55.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57982024-11-06T00:22:55.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57992024-11-06T00:22:55.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58002024-11-06T00:22:55.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58012024-11-06T00:22:55.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58022024-11-06T00:22:55.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58032024-11-06T00:22:55.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58042024-11-06T00:22:55.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58052024-11-06T00:22:55.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58062024-11-06T00:22:55.821ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58072024-11-06T00:22:55.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58082024-11-06T00:22:55.821ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1239, tv_nsec: 162230711 } })
58092024-11-06T00:22:55.821ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
58102024-11-06T00:22:55.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58112024-11-06T00:22:55.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58122024-11-06T00:22:55.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58132024-11-06T00:22:55.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58142024-11-06T00:22:55.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58152024-11-06T00:22:55.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58162024-11-06T00:22:55.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58172024-11-06T00:22:55.825ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58182024-11-06T00:22:55.825ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.504439ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58192024-11-06T00:22:55.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58202024-11-06T00:22:55.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58212024-11-06T00:22:55.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58222024-11-06T00:22:55.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58232024-11-06T00:22:55.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58242024-11-06T00:22:55.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58252024-11-06T00:22:55.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58262024-11-06T00:22:55.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58272024-11-06T00:22:55.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
58282024-11-06T00:22:55.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58292024-11-06T00:22:55.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58302024-11-06T00:22:55.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58312024-11-06T00:22:55.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58322024-11-06T00:22:55.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58332024-11-06T00:22:55.840ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
58342024-11-06T00:22:55.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.130452ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
58352024-11-06T00:22:55.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58362024-11-06T00:22:55.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58372024-11-06T00:22:55.849ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58382024-11-06T00:22:55.849ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
58392024-11-06T00:22:55.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58402024-11-06T00:22:55.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58412024-11-06T00:22:55.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 45.151681ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58422024-11-06T00:22:55.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58432024-11-06T00:22:55.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58442024-11-06T00:22:55.905ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
58452024-11-06T00:22:55.905ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58462024-11-06T00:22:55.905ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bf10882-643e-4e60-98b1-7a9df0128bbf", "content-length": "26", "date": "Wed, 06 Nov 2024 00:22:55 GMT"} })
58472024-11-06T00:22:55.905ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58482024-11-06T00:22:55.907ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58492024-11-06T00:22:55.908ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
58502024-11-06T00:22:55.908ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58512024-11-06T00:22:55.909ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3decd41-fc9d-45e8-87fb-08be592c44ba", "content-length": "26", "date": "Wed, 06 Nov 2024 00:22:55 GMT"} })
58522024-11-06T00:22:55.909ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58532024-11-06T00:22:55.910ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58542024-11-06T00:22:55.924ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
58552024-11-06T00:22:55.924ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58562024-11-06T00:22:55.924ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cf65947-5df1-4dba-867f-883732d5a0d4", "content-length": "26", "date": "Wed, 06 Nov 2024 00:22:55 GMT"} })
58572024-11-06T00:22:55.924ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58582024-11-06T00:22:55.926ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
58592024-11-06T00:22:55.926ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
58602024-11-06T00:22:55.926ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58612024-11-06T00:22:55.926ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4726591-ffe6-413d-99be-d5a7cbda309b", "content-length": "372", "date": "Wed, 06 Nov 2024 00:22:55 GMT"} })
58622024-11-06T00:22:55.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58632024-11-06T00:22:55.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58642024-11-06T00:22:55.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58652024-11-06T00:22:55.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58662024-11-06T00:22:55.930ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58672024-11-06T00:22:55.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58682024-11-06T00:22:55.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58692024-11-06T00:22:55.931ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58702024-11-06T00:22:55.931ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58712024-11-06T00:22:55.931ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58722024-11-06T00:22:55.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58732024-11-06T00:22:55.933ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58742024-11-06T00:22:55.934ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58752024-11-06T00:22:55.934ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58762024-11-06T00:22:55.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58772024-11-06T00:22:55.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
58782024-11-06T00:22:55.936ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58792024-11-06T00:22:55.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58802024-11-06T00:22:55.938ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 132.540876ms iteration = 8 status = 0
58812024-11-06T00:22:55.964ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 159.232957ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58822024-11-06T00:22:55.965ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58832024-11-06T00:22:55.965ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58842024-11-06T00:22:55.965ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 159.496245ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
58852024-11-06T00:22:55.974ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
58862024-11-06T00:22:55.974ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
58872024-11-06T00:22:55.974ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "971c35f3-a8db-48e6-ac30-295588d8b75d", "date": "Wed, 06 Nov 2024 00:22:55 GMT"} })
58882024-11-06T00:22:55.974ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58892024-11-06T00:22:55.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58902024-11-06T00:22:55.977ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58912024-11-06T00:22:55.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58922024-11-06T00:22:55.978ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58932024-11-06T00:22:55.980ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58942024-11-06T00:22:55.980ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58952024-11-06T00:22:55.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58962024-11-06T00:22:55.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58972024-11-06T00:22:55.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58982024-11-06T00:22:55.984ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
58992024-11-06T00:22:55.984ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59002024-11-06T00:22:55.984ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2aa7e758-7b51-4c81-9bda-987eac62436b", "date": "Wed, 06 Nov 2024 00:22:55 GMT"} })
59012024-11-06T00:22:55.986ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 180.620162ms iteration = 9 status = {}
59022024-11-06T00:22:56.004ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
59032024-11-06T00:22:56.004ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9bb9f4b-bf8b-4399-acf9-4be2d054807d", "content-length": "1", "date": "Wed, 06 Nov 2024 00:22:55 GMT"} })
59042024-11-06T00:22:56.006ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 201.061179ms iteration = 8 status = {}
59052024-11-06T00:22:56.006ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59062024-11-06T00:22:56.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59072024-11-06T00:22:56.036ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 230.476842ms iteration = 10 status = {"physical_disks_added":0}
59082024-11-06T00:22:56.126ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59092024-11-06T00:22:56.128ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 322.963939ms iteration = 8 status = null
59102024-11-06T00:22:56.153ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ea36e8f-e577-4c63-94e6-79e2cc53a6ba", "content-length": "691", "date": "Wed, 06 Nov 2024 00:22:55 GMT"} })
59112024-11-06T00:22:56.153ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
59122024-11-06T00:22:56.153ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
59132024-11-06T00:22:56.153ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
59142024-11-06T00:22:56.155ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 349.399103ms iteration = 8 status = {}
59152024-11-06T00:22:56.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59162024-11-06T00:22:56.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59172024-11-06T00:22:56.179ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
59182024-11-06T00:22:56.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59192024-11-06T00:22:56.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59202024-11-06T00:22:56.411ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
59212024-11-06T00:22:56.411ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad70e559-71dc-45e9-84f7-87c02b1c96f6", "content-length": "121", "date": "Wed, 06 Nov 2024 00:22:55 GMT"} })
59222024-11-06T00:22:56.411ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
59232024-11-06T00:22:56.411ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
59242024-11-06T00:22:56.411ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
59252024-11-06T00:22:56.411ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59262024-11-06T00:22:56.411ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59272024-11-06T00:22:56.411ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59282024-11-06T00:22:56.411ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59292024-11-06T00:22:56.411ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59302024-11-06T00:22:56.412ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59312024-11-06T00:22:56.412ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59322024-11-06T00:22:56.412ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
59332024-11-06T00:22:56.412ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59342024-11-06T00:22:56.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59352024-11-06T00:22:56.414ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
59362024-11-06T00:22:56.414ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fc08745-4086-4fe5-9e03-0b2d385711fb", "content-length": "2", "date": "Wed, 06 Nov 2024 00:22:55 GMT"} })
59372024-11-06T00:22:56.414ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
59382024-11-06T00:22:56.414ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e0313b2-f08f-453b-9363-c41f9b24de9b", "content-length": "52", "date": "Wed, 06 Nov 2024 00:22:55 GMT"} })
59392024-11-06T00:22:56.414ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
59402024-11-06T00:22:56.414ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
59412024-11-06T00:22:56.510ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "23a72cce-81c2-4322-b0a8-b4c2804ccb7d", "date": "Wed, 06 Nov 2024 00:22:56 GMT"} })
59422024-11-06T00:22:56.510ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
59432024-11-06T00:22:56.510ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
59442024-11-06T00:22:56.510ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b6dfe56-2db3-4c58-a5b2-b27d4b0f5484", "content-length": "669", "date": "Wed, 06 Nov 2024 00:22:56 GMT"} })
59452024-11-06T00:22:56.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59462024-11-06T00:22:56.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59472024-11-06T00:22:56.513ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59482024-11-06T00:22:56.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59492024-11-06T00:22:56.632ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59502024-11-06T00:22:56.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59512024-11-06T00:22:56.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59522024-11-06T00:22:56.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59532024-11-06T00:22:56.642ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 836.996049ms iteration = 8 status = {}
59542024-11-06T00:23:00.035ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:47291
59552024-11-06T00:23:00.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47291 req_id = a04d4060-1f4e-463d-b63d-e1f3a28f22de roles = RoleSet { roles: {} } uri = /metrics/producers
59562024-11-06T00:23:00.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47291 req_id = a04d4060-1f4e-463d-b63d-e1f3a28f22de resource = Database result = Ok(()) uri = /metrics/producers
59572024-11-06T00:23:00.076ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = 7c647f25-eb29-494d-840d-11658133af45
59582024-11-06T00:23:00.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41009 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47291 req_id = a04d4060-1f4e-463d-b63d-e1f3a28f22de response_code = 201 uri = /metrics/producers
59592024-11-06T00:23:01.475ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1166 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = d834723a-7ce8-4d34-88bf-e6069adb6509 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
59602024-11-06T00:23:05.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
59612024-11-06T00:23:05.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59622024-11-06T00:23:05.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
59632024-11-06T00:23:05.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59642024-11-06T00:23:05.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59652024-11-06T00:23:05.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59662024-11-06T00:23:05.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59672024-11-06T00:23:05.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59682024-11-06T00:23:05.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59692024-11-06T00:23:05.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59702024-11-06T00:23:05.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59712024-11-06T00:23:05.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59722024-11-06T00:23:05.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59732024-11-06T00:23:05.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
59742024-11-06T00:23:05.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59752024-11-06T00:23:05.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59762024-11-06T00:23:05.828ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
59772024-11-06T00:23:05.828ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.477457ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
59782024-11-06T00:23:05.834ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59792024-11-06T00:23:05.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59802024-11-06T00:23:05.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.901977ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59812024-11-06T00:23:15.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
59822024-11-06T00:23:15.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59832024-11-06T00:23:15.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
59842024-11-06T00:23:15.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59852024-11-06T00:23:15.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59862024-11-06T00:23:15.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59872024-11-06T00:23:15.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59882024-11-06T00:23:15.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59892024-11-06T00:23:15.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59902024-11-06T00:23:15.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.926047ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59912024-11-06T00:23:15.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59922024-11-06T00:23:15.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59932024-11-06T00:23:15.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59942024-11-06T00:23:15.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59952024-11-06T00:23:15.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59962024-11-06T00:23:15.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59972024-11-06T00:23:15.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
59982024-11-06T00:23:15.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59992024-11-06T00:23:15.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60002024-11-06T00:23:15.827ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
60012024-11-06T00:23:15.827ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.24026ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
60022024-11-06T00:23:16.474ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1525 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = f0f64b63-c8dd-435d-af45-3ceaf8138197 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
60032024-11-06T00:23:21.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = dc9af0d9-ebb9-4d82-be25-0995264ad4d2 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
60042024-11-06T00:23:21.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = dc9af0d9-ebb9-4d82-be25-0995264ad4d2 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
60052024-11-06T00:23:21.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = dc9af0d9-ebb9-4d82-be25-0995264ad4d2 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
60062024-11-06T00:23:21.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 67ba7221-477d-4ff4-8fb0-3b2dbf9f8ce1 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
60072024-11-06T00:23:21.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 67ba7221-477d-4ff4-8fb0-3b2dbf9f8ce1 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
60082024-11-06T00:23:21.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 67ba7221-477d-4ff4-8fb0-3b2dbf9f8ce1 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
60092024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
60102024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
60112024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60122024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
60132024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
60142024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
60152024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
60162024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
60172024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.14\u{b5}s iteration = 9 status = {"errors":[],"records_set_to_done":[]}
60182024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60192024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
60202024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
60212024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
60222024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
60232024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60242024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60252024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
60262024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60272024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
60282024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
60292024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
60302024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
60312024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
60322024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60332024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60342024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
60352024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 10.86\u{b5}s iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
60362024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
60372024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
60382024-11-06T00:23:25.804ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
60392024-11-06T00:23:25.805ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
60402024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60412024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 19.4\u{b5}s iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
60422024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60432024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
60442024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
60452024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
60462024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.23\u{b5}s iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
60472024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60482024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
60492024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
60502024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
60512024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60522024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
60532024-11-06T00:23:25.805ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
60542024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
60552024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
60562024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
60572024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
60582024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60592024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
60602024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
60612024-11-06T00:23:25.805ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-06 00:13:25.804939968 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
60622024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
60632024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
60642024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60652024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60662024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
60672024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
60682024-11-06T00:23:25.805ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846
60692024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.97\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846"}
60702024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
60712024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60722024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
60732024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60742024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60752024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60762024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
60772024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60782024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
60792024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60802024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60812024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60822024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60832024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60842024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60852024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60862024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60872024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
60882024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60892024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60902024-11-06T00:23:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60912024-11-06T00:23:25.805ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51df9631-cef5-49ae-8cfd-f0c05bdac388.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7102227a-61f8-4dda-a9a0-f6678fae71c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1269, tv_nsec: 146776602 } })
60922024-11-06T00:23:25.805ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("309c9aef-da72-4f08-9f70-c20d80316472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1269, tv_nsec: 146791972 } })
60932024-11-06T00:23:25.806ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
60942024-11-06T00:23:25.806ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
60952024-11-06T00:23:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.217946ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
60962024-11-06T00:23:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.268358ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
60972024-11-06T00:23:25.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60982024-11-06T00:23:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60992024-11-06T00:23:25.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61002024-11-06T00:23:25.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61012024-11-06T00:23:25.809ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.946057ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
61022024-11-06T00:23:25.810ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
61032024-11-06T00:23:25.810ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
61042024-11-06T00:23:25.810ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 5.420071ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
61052024-11-06T00:23:25.810ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1269, tv_nsec: 151345228 } })
61062024-11-06T00:23:25.810ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1269, tv_nsec: 151576804 } })
61072024-11-06T00:23:25.810ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
61082024-11-06T00:23:25.810ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
61092024-11-06T00:23:25.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61102024-11-06T00:23:25.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61112024-11-06T00:23:25.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61122024-11-06T00:23:25.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61132024-11-06T00:23:25.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61142024-11-06T00:23:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61152024-11-06T00:23:25.813ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61162024-11-06T00:23:25.814ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.550253ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
61172024-11-06T00:23:25.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61182024-11-06T00:23:25.815ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61192024-11-06T00:23:25.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
61202024-11-06T00:23:25.816ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61212024-11-06T00:23:25.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61222024-11-06T00:23:25.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61232024-11-06T00:23:25.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61242024-11-06T00:23:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61252024-11-06T00:23:25.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61262024-11-06T00:23:25.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61272024-11-06T00:23:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61282024-11-06T00:23:25.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61292024-11-06T00:23:25.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61302024-11-06T00:23:25.819ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61312024-11-06T00:23:25.819ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61322024-11-06T00:23:25.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61332024-11-06T00:23:25.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61342024-11-06T00:23:25.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61352024-11-06T00:23:25.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61362024-11-06T00:23:25.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61372024-11-06T00:23:25.820ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-06 00:13:25.804939968 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
61382024-11-06T00:23:25.820ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.520501ms iteration = 5 status = {"expiration":"2024-11-06T00:13:25.804939968Z","pruned":[]}
61392024-11-06T00:23:25.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61402024-11-06T00:23:25.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61412024-11-06T00:23:25.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61422024-11-06T00:23:25.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61432024-11-06T00:23:25.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
61442024-11-06T00:23:25.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61452024-11-06T00:23:25.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61462024-11-06T00:23:25.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1269, tv_nsec: 167389444 } })
61472024-11-06T00:23:25.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61482024-11-06T00:23:25.826ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
61492024-11-06T00:23:25.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61502024-11-06T00:23:25.829ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61512024-11-06T00:23:25.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61522024-11-06T00:23:25.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61532024-11-06T00:23:25.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61542024-11-06T00:23:25.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61552024-11-06T00:23:25.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61562024-11-06T00:23:25.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61572024-11-06T00:23:25.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61582024-11-06T00:23:25.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61592024-11-06T00:23:25.865ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61602024-11-06T00:23:25.866ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61612024-11-06T00:23:25.866ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61622024-11-06T00:23:25.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61632024-11-06T00:23:25.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61642024-11-06T00:23:25.866ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
61652024-11-06T00:23:25.866ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
61662024-11-06T00:23:25.866ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 61.839685ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
61672024-11-06T00:23:25.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61682024-11-06T00:23:25.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61692024-11-06T00:23:25.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61702024-11-06T00:23:25.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61712024-11-06T00:23:25.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61722024-11-06T00:23:25.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61732024-11-06T00:23:25.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61742024-11-06T00:23:25.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61752024-11-06T00:23:25.871ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61762024-11-06T00:23:25.872ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
61772024-11-06T00:23:25.872ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.749361ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
61782024-11-06T00:23:25.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.188464ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61792024-11-06T00:23:25.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
61802024-11-06T00:23:25.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61812024-11-06T00:23:25.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61822024-11-06T00:23:25.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61832024-11-06T00:23:25.873ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61842024-11-06T00:23:25.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61852024-11-06T00:23:25.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61862024-11-06T00:23:25.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61872024-11-06T00:23:25.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61882024-11-06T00:23:25.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61892024-11-06T00:23:25.875ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61902024-11-06T00:23:25.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61912024-11-06T00:23:25.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61922024-11-06T00:23:25.876ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61932024-11-06T00:23:25.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
61942024-11-06T00:23:25.880ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61952024-11-06T00:23:25.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61962024-11-06T00:23:25.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61972024-11-06T00:23:25.897ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
61982024-11-06T00:23:25.897ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.6108ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
61992024-11-06T00:23:25.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
62002024-11-06T00:23:25.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 96.461114ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62012024-11-06T00:23:25.905ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
62022024-11-06T00:23:25.906ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
62032024-11-06T00:23:25.906ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
62042024-11-06T00:23:25.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62052024-11-06T00:23:25.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62062024-11-06T00:23:25.906ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62072024-11-06T00:23:25.906ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62082024-11-06T00:23:25.906ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 101.946156ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
62092024-11-06T00:23:25.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62102024-11-06T00:23:25.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62112024-11-06T00:23:25.910ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62122024-11-06T00:23:25.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62132024-11-06T00:23:25.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62142024-11-06T00:23:25.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
62152024-11-06T00:23:25.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62162024-11-06T00:23:25.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62172024-11-06T00:23:25.918ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
62182024-11-06T00:23:25.918ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
62192024-11-06T00:23:25.918ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
62202024-11-06T00:23:25.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62212024-11-06T00:23:25.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62222024-11-06T00:23:25.918ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 113.987274ms iteration = 9 status = 0
62232024-11-06T00:23:25.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62242024-11-06T00:23:25.922ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62252024-11-06T00:23:25.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62262024-11-06T00:23:25.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62272024-11-06T00:23:25.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62282024-11-06T00:23:25.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62292024-11-06T00:23:25.944ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62302024-11-06T00:23:25.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62312024-11-06T00:23:25.945ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
62322024-11-06T00:23:25.945ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
62332024-11-06T00:23:25.945ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62342024-11-06T00:23:25.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62352024-11-06T00:23:25.960ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
62362024-11-06T00:23:25.960ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
62372024-11-06T00:23:25.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62382024-11-06T00:23:25.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62392024-11-06T00:23:25.963ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62402024-11-06T00:23:25.966ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62412024-11-06T00:23:25.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62422024-11-06T00:23:25.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62432024-11-06T00:23:25.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62442024-11-06T00:23:25.968ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62452024-11-06T00:23:25.968ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62462024-11-06T00:23:25.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62472024-11-06T00:23:25.969ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
62482024-11-06T00:23:25.969ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
62492024-11-06T00:23:25.969ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-06 00:19:33.391850 UTC dns_group = external generation = 2
62502024-11-06T00:23:25.969ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 164.629828ms iteration = 6 status = {"generation":2}
62512024-11-06T00:23:25.971ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
62522024-11-06T00:23:25.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62532024-11-06T00:23:25.988ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62542024-11-06T00:23:25.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62552024-11-06T00:23:25.988ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
62562024-11-06T00:23:25.988ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62572024-11-06T00:23:25.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62582024-11-06T00:23:25.989ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de6f2567-511b-4d36-901f-9c4cb14dd24f", "content-length": "26", "date": "Wed, 06 Nov 2024 00:23:25 GMT"} })
62592024-11-06T00:23:25.989ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62602024-11-06T00:23:25.991ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
62612024-11-06T00:23:25.991ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
62622024-11-06T00:23:25.991ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-06 00:19:32.804378 UTC dns_group = internal generation = 1
62632024-11-06T00:23:25.991ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 186.541908ms iteration = 6 status = {"generation":1}
62642024-11-06T00:23:25.991ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62652024-11-06T00:23:26.001ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 196.7177ms iteration = 11 status = {"physical_disks_added":0}
62662024-11-06T00:23:26.005ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
62672024-11-06T00:23:26.005ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62682024-11-06T00:23:26.005ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "01436904-c4fb-4b76-97d7-5d5b5fd0bea8", "content-length": "26", "date": "Wed, 06 Nov 2024 00:23:25 GMT"} })
62692024-11-06T00:23:26.006ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62702024-11-06T00:23:26.007ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
62712024-11-06T00:23:26.015ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
62722024-11-06T00:23:26.015ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 210.48994ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
62732024-11-06T00:23:26.031ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-06T00:19:22.736570Z, time_modified: 2024-11-06T00:19:22.736570Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }) }
62742024-11-06T00:23:26.031ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 226.363231ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]}},"default_endpoint":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
62752024-11-06T00:23:26.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62762024-11-06T00:23:26.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62772024-11-06T00:23:26.066ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
62782024-11-06T00:23:26.128ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
62792024-11-06T00:23:26.128ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62802024-11-06T00:23:26.128ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d1db533-c51b-46de-8a80-05e1f080aef7", "content-length": "26", "date": "Wed, 06 Nov 2024 00:23:25 GMT"} })
62812024-11-06T00:23:26.128ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62822024-11-06T00:23:26.130ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62832024-11-06T00:23:26.178ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
62842024-11-06T00:23:26.276ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
62852024-11-06T00:23:26.276ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62862024-11-06T00:23:26.277ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9812a0cc-4148-48f5-beaa-6eb7f29d84f3", "content-length": "372", "date": "Wed, 06 Nov 2024 00:23:25 GMT"} })
62872024-11-06T00:23:26.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62882024-11-06T00:23:26.277ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
62892024-11-06T00:23:26.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62902024-11-06T00:23:26.278ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d54a1804-3445-4e28-acd4-67fcd3f9cc09", "date": "Wed, 06 Nov 2024 00:23:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62912024-11-06T00:23:26.278ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62922024-11-06T00:23:26.280ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "72fe7ebe-3256-4a25-8cda-2ef653d4d79d", "date": "Wed, 06 Nov 2024 00:23:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62932024-11-06T00:23:26.280ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62942024-11-06T00:23:26.282ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62952024-11-06T00:23:26.282ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 477.62426ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
62962024-11-06T00:23:26.293ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 488.603666ms iteration = 9 status = {}
62972024-11-06T00:23:26.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62982024-11-06T00:23:26.307ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62992024-11-06T00:23:26.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63002024-11-06T00:23:26.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63012024-11-06T00:23:26.318ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
63022024-11-06T00:23:26.318ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
63032024-11-06T00:23:26.319ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3fcb247d-d785-4716-9432-c580dea2a98a", "date": "Wed, 06 Nov 2024 00:23:25 GMT"} })
63042024-11-06T00:23:26.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63052024-11-06T00:23:26.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63062024-11-06T00:23:26.323ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63072024-11-06T00:23:26.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63082024-11-06T00:23:26.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63092024-11-06T00:23:26.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63102024-11-06T00:23:26.330ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
63112024-11-06T00:23:26.330ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63122024-11-06T00:23:26.330ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c0007db1-7a01-4ec8-95d6-e18d88aaf084", "date": "Wed, 06 Nov 2024 00:23:25 GMT"} })
63132024-11-06T00:23:26.332ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 527.831621ms iteration = 10 status = {}
63142024-11-06T00:23:26.339ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63152024-11-06T00:23:26.340ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63162024-11-06T00:23:26.340ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63172024-11-06T00:23:26.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63182024-11-06T00:23:26.413ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63192024-11-06T00:23:26.413ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
63202024-11-06T00:23:26.413ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "223de625-781d-4525-b367-951dd6954d71", "content-length": "1", "date": "Wed, 06 Nov 2024 00:23:26 GMT"} })
63212024-11-06T00:23:26.414ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "051d7893-0896-493e-aa0f-30ab33ec27c5", "date": "Wed, 06 Nov 2024 00:23:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63222024-11-06T00:23:26.414ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63232024-11-06T00:23:26.415ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63242024-11-06T00:23:26.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63252024-11-06T00:23:26.416ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "94e5015d-670c-4b21-b1af-f73cdc85670b", "date": "Wed, 06 Nov 2024 00:23:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63262024-11-06T00:23:26.416ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63272024-11-06T00:23:26.418ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 613.764142ms iteration = 9 status = null
63282024-11-06T00:23:26.418ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "69e69717-01b5-415c-95d5-d67dfda88358", "date": "Wed, 06 Nov 2024 00:23:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63292024-11-06T00:23:26.418ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63302024-11-06T00:23:26.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63312024-11-06T00:23:26.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63322024-11-06T00:23:26.421ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63332024-11-06T00:23:26.421ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 616.221435ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
63342024-11-06T00:23:26.440ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63352024-11-06T00:23:26.440ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d114eb2-0365-48b3-928d-a9eb1b0966d8", "content-length": "691", "date": "Wed, 06 Nov 2024 00:23:25 GMT"} })
63362024-11-06T00:23:26.440ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
63372024-11-06T00:23:26.440ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
63382024-11-06T00:23:26.440ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
63392024-11-06T00:23:26.442ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 637.340623ms iteration = 9 status = {}
63402024-11-06T00:23:26.442ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
63412024-11-06T00:23:26.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63422024-11-06T00:23:26.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63432024-11-06T00:23:26.452ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63442024-11-06T00:23:26.452ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9dad2d9-c4ee-4cfb-a132-5d35b4092482", "content-length": "121", "date": "Wed, 06 Nov 2024 00:23:26 GMT"} })
63452024-11-06T00:23:26.452ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
63462024-11-06T00:23:26.452ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
63472024-11-06T00:23:26.452ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
63482024-11-06T00:23:26.452ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63492024-11-06T00:23:26.452ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63502024-11-06T00:23:26.452ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63512024-11-06T00:23:26.452ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63522024-11-06T00:23:26.452ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63532024-11-06T00:23:26.453ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63542024-11-06T00:23:26.453ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63552024-11-06T00:23:26.453ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
63562024-11-06T00:23:26.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63572024-11-06T00:23:26.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63582024-11-06T00:23:26.455ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63592024-11-06T00:23:26.455ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "65029d0e-b4ed-4f0f-8d9d-084abad56a59", "content-length": "2", "date": "Wed, 06 Nov 2024 00:23:26 GMT"} })
63602024-11-06T00:23:26.455ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63612024-11-06T00:23:26.455ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2ad7844-5bc4-43e8-a1b1-cc87f747adb7", "content-length": "52", "date": "Wed, 06 Nov 2024 00:23:26 GMT"} })
63622024-11-06T00:23:26.455ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
63632024-11-06T00:23:26.455ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63642024-11-06T00:23:26.549ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b793c21d-28cd-421e-9f39-937921b0e21d", "date": "Wed, 06 Nov 2024 00:23:25 GMT"} })
63652024-11-06T00:23:26.549ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
63662024-11-06T00:23:26.549ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63672024-11-06T00:23:26.550ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "57414788-224d-4801-b9e3-d2ef3f654c7a", "content-length": "669", "date": "Wed, 06 Nov 2024 00:23:25 GMT"} })
63682024-11-06T00:23:26.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63692024-11-06T00:23:26.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63702024-11-06T00:23:26.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63712024-11-06T00:23:26.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63722024-11-06T00:23:26.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63732024-11-06T00:23:26.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63742024-11-06T00:23:26.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63752024-11-06T00:23:26.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63762024-11-06T00:23:26.566ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 761.934941ms iteration = 9 status = {}
63772024-11-06T00:23:28.956ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:34344
63782024-11-06T00:23:28.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34344 req_id = 005f0018-821e-47d0-8771-c5275eda92c4 roles = RoleSet { roles: {} } uri = /metrics/producers
63792024-11-06T00:23:28.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34344 req_id = 005f0018-821e-47d0-8771-c5275eda92c4 resource = Database result = Ok(()) uri = /metrics/producers
63802024-11-06T00:23:28.997ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = eeaea349-a304-4c2f-97f2-4ab76b77beee
63812024-11-06T00:23:28.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40778 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34344 req_id = 005f0018-821e-47d0-8771-c5275eda92c4 response_code = 201 uri = /metrics/producers
63822024-11-06T00:23:31.476ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1331 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = f0c67f87-71ff-41a9-bcef-8dcf73f50949 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
63832024-11-06T00:23:35.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
63842024-11-06T00:23:35.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63852024-11-06T00:23:35.804ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
63862024-11-06T00:23:35.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63872024-11-06T00:23:35.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63882024-11-06T00:23:35.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63892024-11-06T00:23:35.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63902024-11-06T00:23:35.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63912024-11-06T00:23:35.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63922024-11-06T00:23:35.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63932024-11-06T00:23:35.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63942024-11-06T00:23:35.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63952024-11-06T00:23:35.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63962024-11-06T00:23:35.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63972024-11-06T00:23:35.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63982024-11-06T00:23:35.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
63992024-11-06T00:23:35.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64002024-11-06T00:23:35.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64012024-11-06T00:23:35.827ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
64022024-11-06T00:23:35.827ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.684103ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
64032024-11-06T00:23:35.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.337941ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64042024-11-06T00:23:36.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 086dd821-cf43-4ac1-a1d9-73ae1fd93044 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
64052024-11-06T00:23:36.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 086dd821-cf43-4ac1-a1d9-73ae1fd93044 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
64062024-11-06T00:23:36.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 086dd821-cf43-4ac1-a1d9-73ae1fd93044 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
64072024-11-06T00:23:36.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 2aca8100-98c9-4624-aa42-15931a17b382 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
64082024-11-06T00:23:36.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 2aca8100-98c9-4624-aa42-15931a17b382 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
64092024-11-06T00:23:36.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 2aca8100-98c9-4624-aa42-15931a17b382 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
64102024-11-06T00:23:45.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
64112024-11-06T00:23:45.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64122024-11-06T00:23:45.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
64132024-11-06T00:23:45.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64142024-11-06T00:23:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64152024-11-06T00:23:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64162024-11-06T00:23:45.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64172024-11-06T00:23:45.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64182024-11-06T00:23:45.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64192024-11-06T00:23:45.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64202024-11-06T00:23:45.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64212024-11-06T00:23:45.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64222024-11-06T00:23:45.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64232024-11-06T00:23:45.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
64242024-11-06T00:23:45.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64252024-11-06T00:23:45.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64262024-11-06T00:23:45.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
64272024-11-06T00:23:45.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.90356ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
64282024-11-06T00:23:45.832ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64292024-11-06T00:23:45.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64302024-11-06T00:23:45.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.739752ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64312024-11-06T00:23:46.475ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1058 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = e35f8988-3a31-42d0-9040-6d414e4b1f62 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
64322024-11-06T00:23:49.717ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:58196
64332024-11-06T00:23:49.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58196 req_id = 8fd6cf85-a8f4-42c9-923e-4396284f478c roles = RoleSet { roles: {} } uri = /metrics/producers
64342024-11-06T00:23:49.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58196 req_id = 8fd6cf85-a8f4-42c9-923e-4396284f478c resource = Database result = Ok(()) uri = /metrics/producers
64352024-11-06T00:23:49.756ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = 9c1a1f66-8a95-49da-beda-497b56ec3bbf
64362024-11-06T00:23:49.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38919 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58196 req_id = 8fd6cf85-a8f4-42c9-923e-4396284f478c response_code = 201 uri = /metrics/producers
64372024-11-06T00:23:55.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
64382024-11-06T00:23:55.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64392024-11-06T00:23:55.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
64402024-11-06T00:23:55.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
64412024-11-06T00:23:55.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64422024-11-06T00:23:55.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 14.961\u{b5}s iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
64432024-11-06T00:23:55.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
64442024-11-06T00:23:55.803ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
64452024-11-06T00:23:55.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.68\u{b5}s iteration = 10 status = {"errors":[],"records_set_to_done":[]}
64462024-11-06T00:23:55.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
64472024-11-06T00:23:55.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.31\u{b5}s iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
64482024-11-06T00:23:55.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
64492024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
64502024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.91\u{b5}s iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
64512024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64522024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64532024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
64542024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
64552024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
64562024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64572024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
64582024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
64592024-11-06T00:23:55.804ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
64602024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
64612024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64622024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64632024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
64642024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
64652024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64662024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64672024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
64682024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64692024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
64702024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
64712024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64722024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64732024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64742024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64752024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
64762024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64772024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64782024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64792024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64802024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64812024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64822024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64832024-11-06T00:23:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64842024-11-06T00:23:55.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64852024-11-06T00:23:55.808ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.060251ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64862024-11-06T00:23:55.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64872024-11-06T00:23:55.809ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1299, tv_nsec: 150881234 } })
64882024-11-06T00:23:55.809ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
64892024-11-06T00:23:55.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64902024-11-06T00:23:55.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64912024-11-06T00:23:55.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64922024-11-06T00:23:55.810ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64932024-11-06T00:23:55.810ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
64942024-11-06T00:23:55.810ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64952024-11-06T00:23:55.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64962024-11-06T00:23:55.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
64972024-11-06T00:23:55.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64982024-11-06T00:23:55.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64992024-11-06T00:23:55.815ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1299, tv_nsec: 157013796 } })
65002024-11-06T00:23:55.815ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65012024-11-06T00:23:55.815ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
65022024-11-06T00:23:55.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65032024-11-06T00:23:55.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65042024-11-06T00:23:55.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65052024-11-06T00:23:55.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65062024-11-06T00:23:55.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65072024-11-06T00:23:55.821ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65082024-11-06T00:23:55.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65092024-11-06T00:23:55.821ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1299, tv_nsec: 163543880 } })
65102024-11-06T00:23:55.822ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
65112024-11-06T00:23:55.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65122024-11-06T00:23:55.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65132024-11-06T00:23:55.842ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65142024-11-06T00:23:55.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65152024-11-06T00:23:55.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65162024-11-06T00:23:55.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65172024-11-06T00:23:55.850ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65182024-11-06T00:23:55.850ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
65192024-11-06T00:23:55.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65202024-11-06T00:23:55.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65212024-11-06T00:23:55.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65222024-11-06T00:23:55.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
65232024-11-06T00:23:55.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65242024-11-06T00:23:55.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65252024-11-06T00:23:55.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65262024-11-06T00:23:55.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65272024-11-06T00:23:55.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65282024-11-06T00:23:55.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65292024-11-06T00:23:55.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65302024-11-06T00:23:55.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65312024-11-06T00:23:55.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65322024-11-06T00:23:55.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65332024-11-06T00:23:55.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65342024-11-06T00:23:55.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65352024-11-06T00:23:55.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
65362024-11-06T00:23:55.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65372024-11-06T00:23:55.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65382024-11-06T00:23:55.864ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65392024-11-06T00:23:55.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65402024-11-06T00:23:55.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65412024-11-06T00:23:55.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65422024-11-06T00:23:55.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65432024-11-06T00:23:55.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65442024-11-06T00:23:55.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65452024-11-06T00:23:55.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65462024-11-06T00:23:55.883ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
65472024-11-06T00:23:55.883ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.720646ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
65482024-11-06T00:23:55.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
65492024-11-06T00:23:55.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65502024-11-06T00:23:55.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65512024-11-06T00:23:55.886ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
65522024-11-06T00:23:55.886ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65532024-11-06T00:23:55.886ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 82.699655ms iteration = 10 status = 0
65542024-11-06T00:23:55.886ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ad34d72-d03d-4822-89d9-7990b731fa49", "content-length": "26", "date": "Wed, 06 Nov 2024 00:23:55 GMT"} })
65552024-11-06T00:23:55.886ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65562024-11-06T00:23:55.888ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
65572024-11-06T00:23:55.888ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.445467ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
65582024-11-06T00:23:55.888ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65592024-11-06T00:23:55.890ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65602024-11-06T00:23:55.890ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
65612024-11-06T00:23:55.890ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 86.848108ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
65622024-11-06T00:23:55.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.410005ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
65632024-11-06T00:23:55.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.055193ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65642024-11-06T00:23:55.899ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
65652024-11-06T00:23:55.899ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65662024-11-06T00:23:55.899ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "77d5befa-a6fd-4229-8aa7-d5cc8a3d7f68", "content-length": "26", "date": "Wed, 06 Nov 2024 00:23:55 GMT"} })
65672024-11-06T00:23:55.899ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65682024-11-06T00:23:55.900ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
65692024-11-06T00:23:55.900ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65702024-11-06T00:23:55.900ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0d33e90-f893-4dd7-83ca-d8e02d0d187e", "content-length": "26", "date": "Wed, 06 Nov 2024 00:23:55 GMT"} })
65712024-11-06T00:23:55.900ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65722024-11-06T00:23:55.901ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65732024-11-06T00:23:55.902ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
65742024-11-06T00:23:55.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65752024-11-06T00:23:55.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65762024-11-06T00:23:55.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65772024-11-06T00:23:55.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65782024-11-06T00:23:55.938ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65792024-11-06T00:23:55.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65802024-11-06T00:23:55.972ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 168.74015ms iteration = 10 status = {}
65812024-11-06T00:23:55.978ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
65822024-11-06T00:23:55.979ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b7c183e-e74b-48c5-af3b-7b19e22d1ef0", "content-length": "1", "date": "Wed, 06 Nov 2024 00:23:55 GMT"} })
65832024-11-06T00:23:55.980ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65842024-11-06T00:23:55.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65852024-11-06T00:23:55.981ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 177.816059ms iteration = 12 status = {"physical_disks_added":0}
65862024-11-06T00:23:55.982ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 178.613653ms iteration = 10 status = null
65872024-11-06T00:23:56.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65882024-11-06T00:23:56.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65892024-11-06T00:23:56.044ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
65902024-11-06T00:23:56.044ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65912024-11-06T00:23:56.045ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "534bd7da-5f6b-4b90-85db-9aa055388d03", "content-length": "372", "date": "Wed, 06 Nov 2024 00:23:56 GMT"} })
65922024-11-06T00:23:56.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65932024-11-06T00:23:56.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65942024-11-06T00:23:56.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65952024-11-06T00:23:56.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65962024-11-06T00:23:56.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65972024-11-06T00:23:56.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65982024-11-06T00:23:56.050ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65992024-11-06T00:23:56.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66002024-11-06T00:23:56.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66012024-11-06T00:23:56.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66022024-11-06T00:23:56.086ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
66032024-11-06T00:23:56.086ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
66042024-11-06T00:23:56.086ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3b8ac6fd-246c-4ed7-b329-d2a5946e05e0", "date": "Wed, 06 Nov 2024 00:23:56 GMT"} })
66052024-11-06T00:23:56.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66062024-11-06T00:23:56.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66072024-11-06T00:23:56.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66082024-11-06T00:23:56.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66092024-11-06T00:23:56.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66102024-11-06T00:23:56.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66112024-11-06T00:23:56.090ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
66122024-11-06T00:23:56.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66132024-11-06T00:23:56.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66142024-11-06T00:23:56.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66152024-11-06T00:23:56.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66162024-11-06T00:23:56.099ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
66172024-11-06T00:23:56.099ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac351df1-0828-481a-b482-f1cb22fc7189", "content-length": "121", "date": "Wed, 06 Nov 2024 00:23:55 GMT"} })
66182024-11-06T00:23:56.099ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
66192024-11-06T00:23:56.099ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
66202024-11-06T00:23:56.100ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
66212024-11-06T00:23:56.100ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
66222024-11-06T00:23:56.100ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66232024-11-06T00:23:56.100ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66242024-11-06T00:23:56.100ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66252024-11-06T00:23:56.100ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66262024-11-06T00:23:56.100ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66272024-11-06T00:23:56.100ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66282024-11-06T00:23:56.100ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
66292024-11-06T00:23:56.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66302024-11-06T00:23:56.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66312024-11-06T00:23:56.102ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
66322024-11-06T00:23:56.102ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3afd906f-9930-498f-bcd1-4eb02ee5dd53", "content-length": "691", "date": "Wed, 06 Nov 2024 00:23:56 GMT"} })
66332024-11-06T00:23:56.102ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
66342024-11-06T00:23:56.102ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
66352024-11-06T00:23:56.102ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
66362024-11-06T00:23:56.103ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 299.409339ms iteration = 10 status = {}
66372024-11-06T00:23:56.104ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
66382024-11-06T00:23:56.104ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "68b8c5b6-5b31-4d07-bc03-e6fea2c67d3a", "content-length": "2", "date": "Wed, 06 Nov 2024 00:23:55 GMT"} })
66392024-11-06T00:23:56.104ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
66402024-11-06T00:23:56.104ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ef3d4ff-22af-44f1-9bd9-29076c47d345", "content-length": "52", "date": "Wed, 06 Nov 2024 00:23:55 GMT"} })
66412024-11-06T00:23:56.105ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
66422024-11-06T00:23:56.105ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
66432024-11-06T00:23:56.105ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
66442024-11-06T00:23:56.105ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66452024-11-06T00:23:56.207ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "60f616f2-b6e0-4c78-b701-ad1b90c9bf3d", "date": "Wed, 06 Nov 2024 00:23:56 GMT"} })
66462024-11-06T00:23:56.207ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
66472024-11-06T00:23:56.207ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
66482024-11-06T00:23:56.207ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "84a5a1ee-a25c-4d54-a479-1c3fc05ffe64", "date": "Wed, 06 Nov 2024 00:23:56 GMT"} })
66492024-11-06T00:23:56.209ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 405.734186ms iteration = 11 status = {}
66502024-11-06T00:23:56.209ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "99869d35-2da4-4f7a-8394-170060c1cfc6", "content-length": "669", "date": "Wed, 06 Nov 2024 00:23:56 GMT"} })
66512024-11-06T00:23:56.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66522024-11-06T00:23:56.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66532024-11-06T00:23:56.213ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66542024-11-06T00:23:56.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66552024-11-06T00:23:56.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66562024-11-06T00:23:56.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66572024-11-06T00:23:56.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66582024-11-06T00:23:56.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66592024-11-06T00:23:56.232ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 428.221313ms iteration = 10 status = {}
66602024-11-06T00:23:59.020ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:38560
66612024-11-06T00:23:59.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38560 req_id = fa573bb2-9714-450b-a38a-88e38c522ba0 roles = RoleSet { roles: {} } uri = /metrics/producers
66622024-11-06T00:23:59.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38560 req_id = fa573bb2-9714-450b-a38a-88e38c522ba0 resource = Database result = Ok(()) uri = /metrics/producers
66632024-11-06T00:23:59.059ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = fed3ec74-af42-4df7-9f71-3957f7103dff
66642024-11-06T00:23:59.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38995 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38560 req_id = fa573bb2-9714-450b-a38a-88e38c522ba0 response_code = 201 uri = /metrics/producers
66652024-11-06T00:24:01.474ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1613 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = d69e9333-176a-4cf2-b551-54e4b8cd74dc response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
66662024-11-06T00:24:05.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
66672024-11-06T00:24:05.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
66682024-11-06T00:24:05.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66692024-11-06T00:24:05.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66702024-11-06T00:24:05.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66712024-11-06T00:24:05.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66722024-11-06T00:24:05.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66732024-11-06T00:24:05.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66742024-11-06T00:24:05.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66752024-11-06T00:24:05.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66762024-11-06T00:24:05.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66772024-11-06T00:24:05.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66782024-11-06T00:24:05.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66792024-11-06T00:24:05.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66802024-11-06T00:24:05.840ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.474473ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66812024-11-06T00:24:05.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66822024-11-06T00:24:05.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
66832024-11-06T00:24:05.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66842024-11-06T00:24:05.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66852024-11-06T00:24:05.887ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
66862024-11-06T00:24:05.887ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.616162ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
66872024-11-06T00:24:06.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 6bb28f6e-4467-43e0-8ab2-3433d2c784cd roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
66882024-11-06T00:24:06.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 6bb28f6e-4467-43e0-8ab2-3433d2c784cd resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
66892024-11-06T00:24:06.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 6bb28f6e-4467-43e0-8ab2-3433d2c784cd response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
66902024-11-06T00:24:06.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = dd78c913-b211-4834-906a-0e3ad01b8991 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
66912024-11-06T00:24:06.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = dd78c913-b211-4834-906a-0e3ad01b8991 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
66922024-11-06T00:24:06.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = dd78c913-b211-4834-906a-0e3ad01b8991 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
66932024-11-06T00:24:15.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
66942024-11-06T00:24:15.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
66952024-11-06T00:24:15.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66962024-11-06T00:24:15.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66972024-11-06T00:24:15.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66982024-11-06T00:24:15.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66992024-11-06T00:24:15.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67002024-11-06T00:24:15.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67012024-11-06T00:24:15.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67022024-11-06T00:24:15.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67032024-11-06T00:24:15.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67042024-11-06T00:24:15.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67052024-11-06T00:24:15.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67062024-11-06T00:24:15.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67072024-11-06T00:24:15.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67082024-11-06T00:24:15.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
67092024-11-06T00:24:15.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67102024-11-06T00:24:15.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67112024-11-06T00:24:15.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
67122024-11-06T00:24:15.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.584021ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
67132024-11-06T00:24:15.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.073723ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67142024-11-06T00:24:16.474ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1225 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 3738d847-fe92-4056-abe3-ae1afccadfe9 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
67152024-11-06T00:24:21.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = adf08743-ad06-43a0-9af5-cdd0bf8601c7 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
67162024-11-06T00:24:21.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = adf08743-ad06-43a0-9af5-cdd0bf8601c7 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
67172024-11-06T00:24:21.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = adf08743-ad06-43a0-9af5-cdd0bf8601c7 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
67182024-11-06T00:24:21.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = d48dd946-3129-4b19-9071-f9404325bd81 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
67192024-11-06T00:24:21.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = d48dd946-3129-4b19-9071-f9404325bd81 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
67202024-11-06T00:24:21.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = d48dd946-3129-4b19-9071-f9404325bd81 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
67212024-11-06T00:24:25.186ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:40940
67222024-11-06T00:24:25.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40940 req_id = e96a7483-4a25-464b-94e6-b731def88b96 roles = RoleSet { roles: {} } uri = /metrics/producers
67232024-11-06T00:24:25.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40940 req_id = e96a7483-4a25-464b-94e6-b731def88b96 resource = Database result = Ok(()) uri = /metrics/producers
67242024-11-06T00:24:25.250ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = a6ef5eb9-ed97-44f5-b038-ae216d3973fd
67252024-11-06T00:24:25.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64535 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40940 req_id = e96a7483-4a25-464b-94e6-b731def88b96 response_code = 201 uri = /metrics/producers
67262024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
67272024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67282024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
67292024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
67302024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
67312024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
67322024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
67332024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
67342024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67352024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
67362024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
67372024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
67382024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67392024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
67402024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67412024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67422024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
67432024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
67442024-11-06T00:24:25.803ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
67452024-11-06T00:24:25.803ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-06 00:14:25.803529135 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
67462024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
67472024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67482024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
67492024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
67502024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.63\u{b5}s iteration = 11 status = {"errors":[],"records_set_to_done":[]}
67512024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
67522024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
67532024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
67542024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67552024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
67562024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67572024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
67582024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
67592024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
67602024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67612024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
67622024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67632024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67642024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
67652024-11-06T00:24:25.803ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846
67662024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.7\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846"}
67672024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
67682024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67692024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
67702024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
67712024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
67722024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67732024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.201\u{b5}s iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
67742024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
67752024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
67762024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.25\u{b5}s iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
67772024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67782024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
67792024-11-06T00:24:25.803ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
67802024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67812024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
67822024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
67832024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
67842024-11-06T00:24:25.803ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
67852024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
67862024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67872024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67882024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
67892024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
67902024-11-06T00:24:25.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.48\u{b5}s iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
67912024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67922024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67932024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67942024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
67952024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67962024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67972024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67982024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67992024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68002024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
68012024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
68022024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68032024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68042024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68052024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68062024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68072024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68082024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
68092024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68102024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68112024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68122024-11-06T00:24:25.804ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("309c9aef-da72-4f08-9f70-c20d80316472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1329, tv_nsec: 146443852 } })
68132024-11-06T00:24:25.804ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51df9631-cef5-49ae-8cfd-f0c05bdac388.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7102227a-61f8-4dda-a9a0-f6678fae71c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1329, tv_nsec: 146460912 } })
68142024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
68152024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 988.609\u{b5}s iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
68162024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
68172024-11-06T00:24:25.804ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.094893ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
68182024-11-06T00:24:25.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68192024-11-06T00:24:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68202024-11-06T00:24:25.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68212024-11-06T00:24:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68222024-11-06T00:24:25.807ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.629308ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
68232024-11-06T00:24:25.807ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1329, tv_nsec: 149533904 } })
68242024-11-06T00:24:25.807ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.03693ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
68252024-11-06T00:24:25.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
68262024-11-06T00:24:25.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68272024-11-06T00:24:25.809ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68282024-11-06T00:24:25.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68292024-11-06T00:24:25.810ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-06 00:14:25.803529135 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
68302024-11-06T00:24:25.811ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.453221ms iteration = 6 status = {"expiration":"2024-11-06T00:14:25.803529135Z","pruned":[]}
68312024-11-06T00:24:25.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
68322024-11-06T00:24:25.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68332024-11-06T00:24:25.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68342024-11-06T00:24:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
68352024-11-06T00:24:25.812ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
68362024-11-06T00:24:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
68372024-11-06T00:24:25.812ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68382024-11-06T00:24:25.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68392024-11-06T00:24:25.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68402024-11-06T00:24:25.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68412024-11-06T00:24:25.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68422024-11-06T00:24:25.815ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1329, tv_nsec: 157798259 } })
68432024-11-06T00:24:25.816ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
68442024-11-06T00:24:25.816ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68452024-11-06T00:24:25.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68462024-11-06T00:24:25.829ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1329, tv_nsec: 171709442 } })
68472024-11-06T00:24:25.829ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
68482024-11-06T00:24:25.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68492024-11-06T00:24:25.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68502024-11-06T00:24:25.830ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68512024-11-06T00:24:25.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68522024-11-06T00:24:25.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68532024-11-06T00:24:25.836ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68542024-11-06T00:24:25.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68552024-11-06T00:24:25.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
68562024-11-06T00:24:25.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68572024-11-06T00:24:25.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68582024-11-06T00:24:25.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68592024-11-06T00:24:25.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
68602024-11-06T00:24:25.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68612024-11-06T00:24:25.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68622024-11-06T00:24:25.853ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
68632024-11-06T00:24:25.853ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.107178ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
68642024-11-06T00:24:25.855ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68652024-11-06T00:24:25.855ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
68662024-11-06T00:24:25.855ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
68672024-11-06T00:24:25.855ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 51.727146ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
68682024-11-06T00:24:25.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68692024-11-06T00:24:25.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68702024-11-06T00:24:25.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68712024-11-06T00:24:25.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68722024-11-06T00:24:25.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68732024-11-06T00:24:25.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68742024-11-06T00:24:25.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68752024-11-06T00:24:25.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68762024-11-06T00:24:25.860ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68772024-11-06T00:24:25.860ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
68782024-11-06T00:24:25.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68792024-11-06T00:24:25.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68802024-11-06T00:24:25.860ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68812024-11-06T00:24:25.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68822024-11-06T00:24:25.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68832024-11-06T00:24:25.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
68842024-11-06T00:24:25.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68852024-11-06T00:24:25.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68862024-11-06T00:24:25.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68872024-11-06T00:24:25.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68882024-11-06T00:24:25.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68892024-11-06T00:24:25.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68902024-11-06T00:24:25.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68912024-11-06T00:24:25.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68922024-11-06T00:24:25.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68932024-11-06T00:24:25.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68942024-11-06T00:24:25.871ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68952024-11-06T00:24:25.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68962024-11-06T00:24:25.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68972024-11-06T00:24:25.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68982024-11-06T00:24:25.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68992024-11-06T00:24:25.875ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
69002024-11-06T00:24:25.875ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
69012024-11-06T00:24:25.875ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.005108ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
69022024-11-06T00:24:25.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.522203ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69032024-11-06T00:24:25.877ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69042024-11-06T00:24:25.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69052024-11-06T00:24:25.880ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69062024-11-06T00:24:25.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69072024-11-06T00:24:25.882ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69082024-11-06T00:24:25.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69092024-11-06T00:24:25.882ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69102024-11-06T00:24:25.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69112024-11-06T00:24:25.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69122024-11-06T00:24:25.884ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69132024-11-06T00:24:25.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69142024-11-06T00:24:25.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69152024-11-06T00:24:25.886ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69162024-11-06T00:24:25.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69172024-11-06T00:24:25.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
69182024-11-06T00:24:25.890ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69192024-11-06T00:24:25.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69202024-11-06T00:24:25.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69212024-11-06T00:24:25.892ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69222024-11-06T00:24:25.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69232024-11-06T00:24:25.893ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69242024-11-06T00:24:25.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69252024-11-06T00:24:25.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69262024-11-06T00:24:25.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69272024-11-06T00:24:25.894ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69282024-11-06T00:24:25.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69292024-11-06T00:24:25.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
69302024-11-06T00:24:25.898ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69312024-11-06T00:24:25.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69322024-11-06T00:24:25.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
69332024-11-06T00:24:25.898ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69342024-11-06T00:24:25.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69352024-11-06T00:24:25.900ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.128123ms iteration = 11 status = 0
69362024-11-06T00:24:25.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 98.427982ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
69372024-11-06T00:24:25.902ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69382024-11-06T00:24:25.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69392024-11-06T00:24:25.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
69402024-11-06T00:24:25.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
69412024-11-06T00:24:25.906ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69422024-11-06T00:24:25.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69432024-11-06T00:24:25.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69442024-11-06T00:24:25.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69452024-11-06T00:24:25.911ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69462024-11-06T00:24:25.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69472024-11-06T00:24:25.913ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69482024-11-06T00:24:25.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69492024-11-06T00:24:25.915ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69502024-11-06T00:24:25.915ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
69512024-11-06T00:24:25.915ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
69522024-11-06T00:24:25.915ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
69532024-11-06T00:24:25.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69542024-11-06T00:24:25.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69552024-11-06T00:24:25.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69562024-11-06T00:24:25.917ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69572024-11-06T00:24:25.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69582024-11-06T00:24:25.918ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69592024-11-06T00:24:25.918ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
69602024-11-06T00:24:25.918ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69612024-11-06T00:24:25.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69622024-11-06T00:24:25.919ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
69632024-11-06T00:24:25.919ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 116.095507ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
69642024-11-06T00:24:25.920ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69652024-11-06T00:24:25.921ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
69662024-11-06T00:24:25.921ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
69672024-11-06T00:24:25.921ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
69682024-11-06T00:24:25.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69692024-11-06T00:24:25.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69702024-11-06T00:24:25.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69712024-11-06T00:24:25.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69722024-11-06T00:24:25.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69732024-11-06T00:24:25.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
69742024-11-06T00:24:25.922ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69752024-11-06T00:24:25.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69762024-11-06T00:24:25.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
69772024-11-06T00:24:25.924ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69782024-11-06T00:24:25.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69792024-11-06T00:24:25.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69802024-11-06T00:24:25.926ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69812024-11-06T00:24:25.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69822024-11-06T00:24:25.927ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69832024-11-06T00:24:25.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69842024-11-06T00:24:25.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69852024-11-06T00:24:25.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69862024-11-06T00:24:25.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69872024-11-06T00:24:25.929ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69882024-11-06T00:24:25.929ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69892024-11-06T00:24:25.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69902024-11-06T00:24:25.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69912024-11-06T00:24:25.930ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69922024-11-06T00:24:25.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69932024-11-06T00:24:25.933ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69942024-11-06T00:24:25.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69952024-11-06T00:24:25.941ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69962024-11-06T00:24:25.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69972024-11-06T00:24:25.952ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69982024-11-06T00:24:25.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69992024-11-06T00:24:25.954ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
70002024-11-06T00:24:25.954ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70012024-11-06T00:24:25.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70022024-11-06T00:24:25.957ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70032024-11-06T00:24:25.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70042024-11-06T00:24:25.959ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70052024-11-06T00:24:25.962ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70062024-11-06T00:24:25.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70072024-11-06T00:24:25.963ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70082024-11-06T00:24:25.963ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
70092024-11-06T00:24:25.963ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 159.709472ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
70102024-11-06T00:24:25.963ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
70112024-11-06T00:24:25.965ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70122024-11-06T00:24:25.965ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
70132024-11-06T00:24:25.965ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70142024-11-06T00:24:25.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70152024-11-06T00:24:25.967ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
70162024-11-06T00:24:25.967ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
70172024-11-06T00:24:25.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70182024-11-06T00:24:25.967ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70192024-11-06T00:24:25.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70202024-11-06T00:24:25.968ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70212024-11-06T00:24:25.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70222024-11-06T00:24:25.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70232024-11-06T00:24:25.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70242024-11-06T00:24:25.977ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
70252024-11-06T00:24:25.977ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
70262024-11-06T00:24:25.977ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70272024-11-06T00:24:25.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70282024-11-06T00:24:25.989ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-06T00:19:22.736570Z, time_modified: 2024-11-06T00:19:22.736570Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }) }
70292024-11-06T00:24:25.989ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 185.688632ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]}},"default_endpoint":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
70302024-11-06T00:24:26.009ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 206.011007ms iteration = 13 status = {"physical_disks_added":0}
70312024-11-06T00:24:26.016ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
70322024-11-06T00:24:26.016ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 213.233ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
70332024-11-06T00:24:26.019ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
70342024-11-06T00:24:26.019ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70352024-11-06T00:24:26.019ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5635947-aac4-406f-8a96-bef9b999e2f8", "content-length": "26", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} })
70362024-11-06T00:24:26.019ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70372024-11-06T00:24:26.021ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
70382024-11-06T00:24:26.112ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
70392024-11-06T00:24:26.112ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70402024-11-06T00:24:26.112ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "887c3f57-44c1-4be0-98a3-96bc164f077f", "content-length": "26", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} })
70412024-11-06T00:24:26.112ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70422024-11-06T00:24:26.114ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70432024-11-06T00:24:26.117ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
70442024-11-06T00:24:26.117ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70452024-11-06T00:24:26.117ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3536dcac-a627-4db2-9516-92fd706e0c8d", "content-length": "26", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} })
70462024-11-06T00:24:26.117ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70472024-11-06T00:24:26.119ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70482024-11-06T00:24:26.150ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
70492024-11-06T00:24:26.151ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9ce3b330-aadb-45d3-8070-c01a17e0e04f", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70502024-11-06T00:24:26.151ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70512024-11-06T00:24:26.152ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5a3ff001-efa1-4ed1-92e6-48425342a0ba", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70522024-11-06T00:24:26.152ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70532024-11-06T00:24:26.154ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70542024-11-06T00:24:26.154ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 350.97506ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
70552024-11-06T00:24:26.244ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 441.134247ms iteration = 11 status = {}
70562024-11-06T00:24:26.244ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
70572024-11-06T00:24:26.245ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
70582024-11-06T00:24:26.245ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70592024-11-06T00:24:26.245ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c44cd0a-5c6a-42af-b995-239877d491ab", "content-length": "372", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} })
70602024-11-06T00:24:26.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70612024-11-06T00:24:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70622024-11-06T00:24:26.246ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
70632024-11-06T00:24:26.246ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "45f28529-66cb-4029-aa33-f8f411608163", "content-length": "1", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} })
70642024-11-06T00:24:26.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70652024-11-06T00:24:26.247ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70662024-11-06T00:24:26.247ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70672024-11-06T00:24:26.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70682024-11-06T00:24:26.248ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70692024-11-06T00:24:26.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70702024-11-06T00:24:26.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70712024-11-06T00:24:26.249ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70722024-11-06T00:24:26.249ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70732024-11-06T00:24:26.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70742024-11-06T00:24:26.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70752024-11-06T00:24:26.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70762024-11-06T00:24:26.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70772024-11-06T00:24:26.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70782024-11-06T00:24:26.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70792024-11-06T00:24:26.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70802024-11-06T00:24:26.252ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70812024-11-06T00:24:26.252ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 448.874967ms iteration = 11 status = null
70822024-11-06T00:24:26.253ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
70832024-11-06T00:24:26.254ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
70842024-11-06T00:24:26.254ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-06 00:19:33.391850 UTC dns_group = external generation = 2
70852024-11-06T00:24:26.254ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 450.316359ms iteration = 7 status = {"generation":2}
70862024-11-06T00:24:26.255ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
70872024-11-06T00:24:26.255ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
70882024-11-06T00:24:26.255ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-06 00:19:32.804378 UTC dns_group = internal generation = 1
70892024-11-06T00:24:26.255ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 451.625199ms iteration = 7 status = {"generation":1}
70902024-11-06T00:24:26.255ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
70912024-11-06T00:24:26.255ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70922024-11-06T00:24:26.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70932024-11-06T00:24:26.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70942024-11-06T00:24:26.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70952024-11-06T00:24:26.266ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70962024-11-06T00:24:26.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70972024-11-06T00:24:26.268ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70982024-11-06T00:24:26.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70992024-11-06T00:24:26.271ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71002024-11-06T00:24:26.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71012024-11-06T00:24:26.272ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71022024-11-06T00:24:26.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71032024-11-06T00:24:26.274ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71042024-11-06T00:24:26.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71052024-11-06T00:24:26.275ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71062024-11-06T00:24:26.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71072024-11-06T00:24:26.284ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
71082024-11-06T00:24:26.284ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "76a31608-9f9c-430f-b44d-eb0036dfbd5c", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71092024-11-06T00:24:26.284ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71102024-11-06T00:24:26.287ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "01e5b739-313a-4122-8ddc-fabd8d9220b4", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71112024-11-06T00:24:26.287ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71122024-11-06T00:24:26.289ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ab8dda0c-3fe0-4f0e-a0a1-f71af88747ae", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71132024-11-06T00:24:26.289ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71142024-11-06T00:24:26.290ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
71152024-11-06T00:24:26.290ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
71162024-11-06T00:24:26.291ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e101e9f4-8ee5-4c77-8666-4ef9d42104e7", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} })
71172024-11-06T00:24:26.291ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71182024-11-06T00:24:26.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71192024-11-06T00:24:26.291ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 487.342639ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
71202024-11-06T00:24:26.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71212024-11-06T00:24:26.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71222024-11-06T00:24:26.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71232024-11-06T00:24:26.298ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71242024-11-06T00:24:26.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71252024-11-06T00:24:26.302ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
71262024-11-06T00:24:26.302ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71272024-11-06T00:24:26.302ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4a263033-102d-4ec7-a23d-aaa0abbf99fd", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} })
71282024-11-06T00:24:26.303ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 499.774658ms iteration = 12 status = {}
71292024-11-06T00:24:26.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71302024-11-06T00:24:26.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71312024-11-06T00:24:26.307ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
71322024-11-06T00:24:26.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71332024-11-06T00:24:26.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71342024-11-06T00:24:26.309ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71352024-11-06T00:24:26.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
71362024-11-06T00:24:26.312ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71372024-11-06T00:24:26.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71382024-11-06T00:24:26.314ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71392024-11-06T00:24:26.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71402024-11-06T00:24:26.315ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
71412024-11-06T00:24:26.315ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71422024-11-06T00:24:26.315ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "591a210c-cce5-44ff-bed5-32b0d069e6b2", "content-length": "121", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} })
71432024-11-06T00:24:26.315ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
71442024-11-06T00:24:26.315ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
71452024-11-06T00:24:26.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71462024-11-06T00:24:26.315ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
71472024-11-06T00:24:26.315ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
71482024-11-06T00:24:26.315ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71492024-11-06T00:24:26.315ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71502024-11-06T00:24:26.315ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71512024-11-06T00:24:26.315ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71522024-11-06T00:24:26.316ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71532024-11-06T00:24:26.316ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71542024-11-06T00:24:26.316ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
71552024-11-06T00:24:26.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71562024-11-06T00:24:26.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71572024-11-06T00:24:26.316ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71582024-11-06T00:24:26.318ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
71592024-11-06T00:24:26.318ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "769b7ca2-a09a-434e-9813-0502ed53071f", "content-length": "2", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} })
71602024-11-06T00:24:26.318ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
71612024-11-06T00:24:26.318ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b625a18-a2aa-40d7-b587-412468d16fc7", "content-length": "52", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} })
71622024-11-06T00:24:26.318ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
71632024-11-06T00:24:26.318ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
71642024-11-06T00:24:26.320ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
71652024-11-06T00:24:26.320ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71662024-11-06T00:24:26.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71672024-11-06T00:24:26.345ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
71682024-11-06T00:24:26.351ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 37bbd7b6-d736-4142-9ad8-60e594545f3d, kind: Service { id: f13e9b98-ae91-4d61-ba9b-3b178cfa151a }, name: Name("nexus-f13e9b98-ae91-4d61-ba9b-3b178cfa151a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acdf8cb7-85f2-4777-8bd4-f403275388d3, kind: Service { id: f633068a-05f8-4be2-a65b-d83ac560f7a9 }, name: Name("nexus-f633068a-05f8-4be2-a65b-d83ac560f7a9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6096ff9-4d2b-4b07-af5b-bb3cff616f69, kind: Service { id: e2378399-e8ed-453c-847a-0a419dfd0966 }, name: Name("nexus-e2378399-e8ed-453c-847a-0a419dfd0966"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 5bdcd428-292d-4d10-9115-282b4950a6c7, kind: Service { id: 309c9aef-da72-4f08-9f70-c20d80316472 }, name: Name("external-dns-309c9aef-da72-4f08-9f70-c20d80316472"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bddae3f-1834-4c3e-96a7-d7374171c136, kind: Service { id: 9bf7f7e3-0a6c-48b6-84be-c4bb8425f761 }, name: Name("external-dns-9bf7f7e3-0a6c-48b6-84be-c4bb8425f761"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
71692024-11-06T00:24:26.351ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71702024-11-06T00:24:26.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71712024-11-06T00:24:26.353ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71722024-11-06T00:24:26.354ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
71732024-11-06T00:24:26.354ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71742024-11-06T00:24:26.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71752024-11-06T00:24:26.357ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
71762024-11-06T00:24:26.357ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5bdcd428-292d-4d10-9115-282b4950a6c7, kind: Service { id: 309c9aef-da72-4f08-9f70-c20d80316472 }, name: Name("external-dns-309c9aef-da72-4f08-9f70-c20d80316472"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bddae3f-1834-4c3e-96a7-d7374171c136, kind: Service { id: 9bf7f7e3-0a6c-48b6-84be-c4bb8425f761 }, name: Name("external-dns-9bf7f7e3-0a6c-48b6-84be-c4bb8425f761"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 37bbd7b6-d736-4142-9ad8-60e594545f3d, kind: Service { id: f13e9b98-ae91-4d61-ba9b-3b178cfa151a }, name: Name("nexus-f13e9b98-ae91-4d61-ba9b-3b178cfa151a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acdf8cb7-85f2-4777-8bd4-f403275388d3, kind: Service { id: f633068a-05f8-4be2-a65b-d83ac560f7a9 }, name: Name("nexus-f633068a-05f8-4be2-a65b-d83ac560f7a9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6096ff9-4d2b-4b07-af5b-bb3cff616f69, kind: Service { id: e2378399-e8ed-453c-847a-0a419dfd0966 }, name: Name("nexus-e2378399-e8ed-453c-847a-0a419dfd0966"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
71772024-11-06T00:24:26.357ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
71782024-11-06T00:24:26.423ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dfc0f7b3-f3a0-4f13-a50e-974036bec3c4", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} })
71792024-11-06T00:24:26.423ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
71802024-11-06T00:24:26.423ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
71812024-11-06T00:24:26.423ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e326e1e9-79dd-4c94-8db1-f3bf25bb13b2", "content-length": "691", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} })
71822024-11-06T00:24:26.423ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
71832024-11-06T00:24:26.423ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
71842024-11-06T00:24:26.423ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
71852024-11-06T00:24:26.423ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a684f0b1-ca99-4af0-878a-b8eae2fa11ea", "content-length": "669", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} })
71862024-11-06T00:24:26.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71872024-11-06T00:24:26.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71882024-11-06T00:24:26.425ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 621.799591ms iteration = 11 status = {}
71892024-11-06T00:24:26.426ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71902024-11-06T00:24:26.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71912024-11-06T00:24:26.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71922024-11-06T00:24:26.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71932024-11-06T00:24:26.431ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71942024-11-06T00:24:26.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71952024-11-06T00:24:26.439ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 635.874809ms iteration = 11 status = {}
71962024-11-06T00:24:26.470ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 7c647f25-eb29-494d-840d-11658133af45, time_created: 2024-11-06T00:19:28.362863Z, time_modified: 2024-11-06T00:19:28.362863Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
71972024-11-06T00:24:26.470ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
71982024-11-06T00:24:26.470ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71992024-11-06T00:24:26.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72002024-11-06T00:24:26.472ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72012024-11-06T00:24:26.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72022024-11-06T00:24:26.474ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72032024-11-06T00:24:26.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
72042024-11-06T00:24:26.506ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
72052024-11-06T00:24:26.507ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "f4a22c6b-1239-432e-aeee-1a52bc248f11", "date": "Wed, 06 Nov 2024 00:24:25 GMT"} })
72062024-11-06T00:24:26.508ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
72072024-11-06T00:24:26.508ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 704.692702ms
72082024-11-06T00:24:26.508ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 704.700522ms iteration = 2 status = {}
72092024-11-06T00:24:31.474ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1175 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = c8f7f74f-d2d2-4499-9a00-112f2d06ac19 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
72102024-11-06T00:24:34.767ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
72112024-11-06T00:24:34.767ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
72122024-11-06T00:24:34.797ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
72132024-11-06T00:24:34.797ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:37469
72142024-11-06T00:24:34.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:37469 req_id = 4fcc583b-b887-4a59-914f-e7395de397b4 roles = RoleSet { roles: {} } uri = /metrics/producers
72152024-11-06T00:24:34.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:37469 req_id = 4fcc583b-b887-4a59-914f-e7395de397b4 resource = Database result = Ok(()) uri = /metrics/producers
72162024-11-06T00:24:34.849ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = e2378399-e8ed-453c-847a-0a419dfd0966
72172024-11-06T00:24:34.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51484 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:37469 req_id = 4fcc583b-b887-4a59-914f-e7395de397b4 response_code = 201 uri = /metrics/producers
72182024-11-06T00:24:34.849ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "4fcc583b-b887-4a59-914f-e7395de397b4", "content-length": "41", "date": "Wed, 06 Nov 2024 00:24:34 GMT"} })
72192024-11-06T00:24:34.851ZDEBGnexus (producer-registration-task): registered with nexus successfully
72202024-11-06T00:24:34.851ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
72212024-11-06T00:24:35.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
72222024-11-06T00:24:35.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72232024-11-06T00:24:35.804ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
72242024-11-06T00:24:35.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72252024-11-06T00:24:35.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72262024-11-06T00:24:35.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72272024-11-06T00:24:35.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72282024-11-06T00:24:35.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72292024-11-06T00:24:35.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72302024-11-06T00:24:35.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.600566ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72312024-11-06T00:24:35.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72322024-11-06T00:24:35.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72332024-11-06T00:24:35.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72342024-11-06T00:24:35.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72352024-11-06T00:24:35.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72362024-11-06T00:24:35.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72372024-11-06T00:24:35.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
72382024-11-06T00:24:35.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72392024-11-06T00:24:35.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72402024-11-06T00:24:35.826ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
72412024-11-06T00:24:35.826ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.939601ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
72422024-11-06T00:24:36.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 7aae0d7e-ea03-4315-a2c7-198f59401897 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
72432024-11-06T00:24:36.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 7aae0d7e-ea03-4315-a2c7-198f59401897 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
72442024-11-06T00:24:36.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 7aae0d7e-ea03-4315-a2c7-198f59401897 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
72452024-11-06T00:24:36.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 0884040b-0421-4f59-b74a-09ee2dbdc738 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
72462024-11-06T00:24:36.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 0884040b-0421-4f59-b74a-09ee2dbdc738 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
72472024-11-06T00:24:36.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 0884040b-0421-4f59-b74a-09ee2dbdc738 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
72482024-11-06T00:24:45.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
72492024-11-06T00:24:45.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72502024-11-06T00:24:45.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
72512024-11-06T00:24:45.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72522024-11-06T00:24:45.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72532024-11-06T00:24:45.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72542024-11-06T00:24:45.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72552024-11-06T00:24:45.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72562024-11-06T00:24:45.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72572024-11-06T00:24:45.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72582024-11-06T00:24:45.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72592024-11-06T00:24:45.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72602024-11-06T00:24:45.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72612024-11-06T00:24:45.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
72622024-11-06T00:24:45.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72632024-11-06T00:24:45.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72642024-11-06T00:24:45.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
72652024-11-06T00:24:45.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.865249ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
72662024-11-06T00:24:45.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72672024-11-06T00:24:45.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72682024-11-06T00:24:45.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.088072ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72692024-11-06T00:24:46.473ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1081 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 930d1985-3f17-453c-9f50-9cc3773977f4 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
72702024-11-06T00:24:48.689ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:34916
72712024-11-06T00:24:48.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34916 req_id = fb92be71-afc1-4378-96e9-39d1c7644d87 roles = RoleSet { roles: {} } uri = /metrics/producers
72722024-11-06T00:24:48.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34916 req_id = fb92be71-afc1-4378-96e9-39d1c7644d87 resource = Database result = Ok(()) uri = /metrics/producers
72732024-11-06T00:24:48.701ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = 57aed6c0-b7d9-4021-84f4-804ca56d1b7a
72742024-11-06T00:24:48.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11368 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34916 req_id = fb92be71-afc1-4378-96e9-39d1c7644d87 response_code = 201 uri = /metrics/producers
72752024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
72762024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72772024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
72782024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
72792024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72802024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
72812024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
72822024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72832024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
72842024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
72852024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72862024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
72872024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
72882024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72892024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.79\u{b5}s iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
72902024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
72912024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
72922024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72932024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.851\u{b5}s iteration = 12 status = {"errors":[],"records_set_to_done":[]}
72942024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
72952024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
72962024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.12\u{b5}s iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
72972024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
72982024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
72992024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.9\u{b5}s iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
73002024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
73012024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73022024-11-06T00:24:55.803ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
73032024-11-06T00:24:55.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73042024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
73052024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
73062024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73072024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73082024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
73092024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73102024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73112024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73122024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73132024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73142024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
73152024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73162024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73172024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73182024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73192024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73202024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73212024-11-06T00:24:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73222024-11-06T00:24:55.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73232024-11-06T00:24:55.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73242024-11-06T00:24:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73252024-11-06T00:24:55.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73262024-11-06T00:24:55.807ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.05332ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
73272024-11-06T00:24:55.808ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73282024-11-06T00:24:55.809ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1359, tv_nsec: 151504072 } })
73292024-11-06T00:24:55.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73302024-11-06T00:24:55.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73312024-11-06T00:24:55.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73322024-11-06T00:24:55.809ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
73332024-11-06T00:24:55.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73342024-11-06T00:24:55.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73352024-11-06T00:24:55.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73362024-11-06T00:24:55.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
73372024-11-06T00:24:55.810ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73382024-11-06T00:24:55.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73392024-11-06T00:24:55.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73402024-11-06T00:24:55.811ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1359, tv_nsec: 154347967 } })
73412024-11-06T00:24:55.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73422024-11-06T00:24:55.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
73432024-11-06T00:24:55.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73442024-11-06T00:24:55.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73452024-11-06T00:24:55.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73462024-11-06T00:24:55.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73472024-11-06T00:24:55.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
73482024-11-06T00:24:55.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73492024-11-06T00:24:55.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73502024-11-06T00:24:55.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 10.911604ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73512024-11-06T00:24:55.815ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73522024-11-06T00:24:55.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73532024-11-06T00:24:55.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73542024-11-06T00:24:55.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73552024-11-06T00:24:55.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
73562024-11-06T00:24:55.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73572024-11-06T00:24:55.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73582024-11-06T00:24:55.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73592024-11-06T00:24:55.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73602024-11-06T00:24:55.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73612024-11-06T00:24:55.823ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1359, tv_nsec: 166136317 } })
73622024-11-06T00:24:55.823ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
73632024-11-06T00:24:55.824ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73642024-11-06T00:24:55.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73652024-11-06T00:24:55.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73662024-11-06T00:24:55.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73672024-11-06T00:24:55.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73682024-11-06T00:24:55.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73692024-11-06T00:24:55.826ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73702024-11-06T00:24:55.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73712024-11-06T00:24:55.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
73722024-11-06T00:24:55.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73732024-11-06T00:24:55.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73742024-11-06T00:24:55.846ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73752024-11-06T00:24:55.846ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
73762024-11-06T00:24:55.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73772024-11-06T00:24:55.846ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
73782024-11-06T00:24:55.846ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.210223ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
73792024-11-06T00:24:55.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73802024-11-06T00:24:55.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73812024-11-06T00:24:55.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73822024-11-06T00:24:55.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73832024-11-06T00:24:55.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73842024-11-06T00:24:55.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73852024-11-06T00:24:55.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73862024-11-06T00:24:55.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73872024-11-06T00:24:55.852ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
73882024-11-06T00:24:55.852ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 49.082217ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
73892024-11-06T00:24:55.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 49.897562ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73902024-11-06T00:24:55.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
73912024-11-06T00:24:55.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73922024-11-06T00:24:55.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73932024-11-06T00:24:55.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73942024-11-06T00:24:55.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73952024-11-06T00:24:55.857ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 53.830339ms iteration = 12 status = 0
73962024-11-06T00:24:55.863ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73972024-11-06T00:24:55.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73982024-11-06T00:24:55.865ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73992024-11-06T00:24:55.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74002024-11-06T00:24:55.867ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74012024-11-06T00:24:55.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74022024-11-06T00:24:55.869ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74032024-11-06T00:24:55.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74042024-11-06T00:24:55.870ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74052024-11-06T00:24:55.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74062024-11-06T00:24:55.875ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74072024-11-06T00:24:55.875ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
74082024-11-06T00:24:55.875ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74092024-11-06T00:24:55.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74102024-11-06T00:24:55.887ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
74112024-11-06T00:24:55.887ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
74122024-11-06T00:24:55.887ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74132024-11-06T00:24:55.887ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74142024-11-06T00:24:55.887ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9012443e-6869-4e63-ad69-b3de1ff9961a", "content-length": "26", "date": "Wed, 06 Nov 2024 00:24:55 GMT"} })
74152024-11-06T00:24:55.887ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74162024-11-06T00:24:55.887ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "00fbd134-d9fd-4ea2-9877-c7e43d549a16", "content-length": "26", "date": "Wed, 06 Nov 2024 00:24:55 GMT"} })
74172024-11-06T00:24:55.887ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74182024-11-06T00:24:55.889ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74192024-11-06T00:24:55.889ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74202024-11-06T00:24:55.898ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
74212024-11-06T00:24:55.898ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74222024-11-06T00:24:55.899ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a0a6303-ccc6-46c1-a7df-05a10222b9b3", "content-length": "26", "date": "Wed, 06 Nov 2024 00:24:55 GMT"} })
74232024-11-06T00:24:55.899ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74242024-11-06T00:24:55.900ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
74252024-11-06T00:24:55.906ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74262024-11-06T00:24:55.906ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
74272024-11-06T00:24:55.906ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 102.185814ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
74282024-11-06T00:24:55.927ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 123.228159ms iteration = 14 status = {"physical_disks_added":0}
74292024-11-06T00:24:56.023ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
74302024-11-06T00:24:56.024ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffd2dc6e-3b72-493a-ad60-81672ef34d5c", "content-length": "1", "date": "Wed, 06 Nov 2024 00:24:55 GMT"} })
74312024-11-06T00:24:56.026ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
74322024-11-06T00:24:56.026ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74332024-11-06T00:24:56.026ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74342024-11-06T00:24:56.027ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "83bc3ab5-7705-43f4-8a1b-a75f05dba5b8", "content-length": "372", "date": "Wed, 06 Nov 2024 00:24:55 GMT"} })
74352024-11-06T00:24:56.027ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74362024-11-06T00:24:56.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74372024-11-06T00:24:56.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74382024-11-06T00:24:56.028ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 225.00648ms iteration = 12 status = null
74392024-11-06T00:24:56.039ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
74402024-11-06T00:24:56.039ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
74412024-11-06T00:24:56.039ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "79c7a911-e4a7-4f10-b9cd-475616e2f47d", "date": "Wed, 06 Nov 2024 00:24:55 GMT"} })
74422024-11-06T00:24:56.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74432024-11-06T00:24:56.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74442024-11-06T00:24:56.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74452024-11-06T00:24:56.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74462024-11-06T00:24:56.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74472024-11-06T00:24:56.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74482024-11-06T00:24:56.049ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
74492024-11-06T00:24:56.049ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74502024-11-06T00:24:56.049ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "52445268-8dd3-4b5e-90b1-aeb6b87e6d34", "date": "Wed, 06 Nov 2024 00:24:55 GMT"} })
74512024-11-06T00:24:56.051ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 247.307762ms iteration = 13 status = {}
74522024-11-06T00:24:56.058ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
74532024-11-06T00:24:56.059ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bc81cfd-d784-4b01-977c-ee79acf1f6b5", "content-length": "691", "date": "Wed, 06 Nov 2024 00:24:55 GMT"} })
74542024-11-06T00:24:56.059ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
74552024-11-06T00:24:56.059ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
74562024-11-06T00:24:56.059ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
74572024-11-06T00:24:56.060ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 256.846466ms iteration = 12 status = {}
74582024-11-06T00:24:56.099ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 296.171553ms iteration = 12 status = {}
74592024-11-06T00:24:56.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74602024-11-06T00:24:56.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74612024-11-06T00:24:56.164ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
74622024-11-06T00:24:56.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74632024-11-06T00:24:56.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74642024-11-06T00:24:56.176ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
74652024-11-06T00:24:56.177ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b027c6f8-c506-45f0-a6d4-6ebbb5de47ac", "content-length": "121", "date": "Wed, 06 Nov 2024 00:24:55 GMT"} })
74662024-11-06T00:24:56.177ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
74672024-11-06T00:24:56.177ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
74682024-11-06T00:24:56.177ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
74692024-11-06T00:24:56.177ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
74702024-11-06T00:24:56.177ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74712024-11-06T00:24:56.177ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74722024-11-06T00:24:56.177ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74732024-11-06T00:24:56.177ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74742024-11-06T00:24:56.177ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74752024-11-06T00:24:56.177ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74762024-11-06T00:24:56.178ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
74772024-11-06T00:24:56.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74782024-11-06T00:24:56.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74792024-11-06T00:24:56.180ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
74802024-11-06T00:24:56.180ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f020d8b-5246-4c16-a2e6-a30e9a0b8ade", "content-length": "2", "date": "Wed, 06 Nov 2024 00:24:55 GMT"} })
74812024-11-06T00:24:56.180ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
74822024-11-06T00:24:56.180ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "32c2945b-891e-4141-9415-ac431618b479", "content-length": "52", "date": "Wed, 06 Nov 2024 00:24:55 GMT"} })
74832024-11-06T00:24:56.180ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
74842024-11-06T00:24:56.180ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
74852024-11-06T00:24:56.292ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "335d019c-2b45-44df-bcab-704b12b4da9c", "date": "Wed, 06 Nov 2024 00:24:55 GMT"} })
74862024-11-06T00:24:56.292ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
74872024-11-06T00:24:56.292ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
74882024-11-06T00:24:56.292ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f474142-901a-499e-afe9-a20c7084c69a", "content-length": "669", "date": "Wed, 06 Nov 2024 00:24:55 GMT"} })
74892024-11-06T00:24:56.292ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74902024-11-06T00:24:56.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74912024-11-06T00:24:56.296ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74922024-11-06T00:24:56.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74932024-11-06T00:24:56.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74942024-11-06T00:24:56.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74952024-11-06T00:24:56.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74962024-11-06T00:24:56.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74972024-11-06T00:24:56.309ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 505.805737ms iteration = 12 status = {}
74982024-11-06T00:25:01.473ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1213 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 97e89d72-481e-478a-bc7e-d286bf9fcbc8 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
74992024-11-06T00:25:05.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
75002024-11-06T00:25:05.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75012024-11-06T00:25:05.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
75022024-11-06T00:25:05.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75032024-11-06T00:25:05.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75042024-11-06T00:25:05.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75052024-11-06T00:25:05.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75062024-11-06T00:25:05.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75072024-11-06T00:25:05.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75082024-11-06T00:25:05.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.917326ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75092024-11-06T00:25:05.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75102024-11-06T00:25:05.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75112024-11-06T00:25:05.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75122024-11-06T00:25:05.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75132024-11-06T00:25:05.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75142024-11-06T00:25:05.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75152024-11-06T00:25:05.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
75162024-11-06T00:25:05.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75172024-11-06T00:25:05.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75182024-11-06T00:25:05.823ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
75192024-11-06T00:25:05.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.227031ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
75202024-11-06T00:25:06.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 7fad2428-5ff4-4e03-912e-7131a66b979e roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
75212024-11-06T00:25:06.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 7fad2428-5ff4-4e03-912e-7131a66b979e resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
75222024-11-06T00:25:06.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2712 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 7fad2428-5ff4-4e03-912e-7131a66b979e response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
75232024-11-06T00:25:06.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 668979ae-bcc5-4812-8e04-0b601ae9ff07 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
75242024-11-06T00:25:06.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 668979ae-bcc5-4812-8e04-0b601ae9ff07 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
75252024-11-06T00:25:06.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1726 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 668979ae-bcc5-4812-8e04-0b601ae9ff07 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
75262024-11-06T00:25:15.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
75272024-11-06T00:25:15.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
75282024-11-06T00:25:15.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75292024-11-06T00:25:15.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75302024-11-06T00:25:15.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75312024-11-06T00:25:15.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75322024-11-06T00:25:15.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75332024-11-06T00:25:15.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75342024-11-06T00:25:15.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75352024-11-06T00:25:15.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.421921ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75362024-11-06T00:25:15.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75372024-11-06T00:25:15.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75382024-11-06T00:25:15.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75392024-11-06T00:25:15.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75402024-11-06T00:25:15.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75412024-11-06T00:25:15.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75422024-11-06T00:25:15.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
75432024-11-06T00:25:15.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75442024-11-06T00:25:15.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75452024-11-06T00:25:15.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
75462024-11-06T00:25:15.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.176549ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
75472024-11-06T00:25:16.472ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1466 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 45139872-1c3b-4ed7-92ae-914670ded6f7 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
75482024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
75492024-11-06T00:25:25.802ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
75502024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
75512024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75522024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
75532024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75542024-11-06T00:25:25.802ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-06 00:15:25.802479386 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
75552024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
75562024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
75572024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
75582024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75592024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
75602024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
75612024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
75622024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75632024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
75642024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
75652024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.1\u{b5}s iteration = 13 status = {"errors":[],"records_set_to_done":[]}
75662024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
75672024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
75682024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75692024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75702024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
75712024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
75722024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
75732024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75742024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
75752024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
75762024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
75772024-11-06T00:25:25.802ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
75782024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
75792024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
75802024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.34\u{b5}s iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
75812024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
75822024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
75832024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75842024-11-06T00:25:25.802ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846
75852024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.39\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846"}
75862024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
75872024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75882024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
75892024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75902024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
75912024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75922024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
75932024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
75942024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75952024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75962024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
75972024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
75982024-11-06T00:25:25.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75992024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
76002024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
76012024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76022024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76032024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
76042024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
76052024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76062024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76072024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
76082024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.21\u{b5}s iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
76092024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
76102024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
76112024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.901\u{b5}s iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
76122024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76132024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76142024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76152024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76162024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76172024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
76182024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
76192024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
76202024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76212024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
76222024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76232024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76242024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76252024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76262024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76272024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76282024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76292024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76302024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76312024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
76322024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76332024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76342024-11-06T00:25:25.803ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51df9631-cef5-49ae-8cfd-f0c05bdac388.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7102227a-61f8-4dda-a9a0-f6678fae71c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1389, tv_nsec: 146376760 } })
76352024-11-06T00:25:25.803ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("309c9aef-da72-4f08-9f70-c20d80316472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1389, tv_nsec: 146385210 } })
76362024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76372024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76382024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76392024-11-06T00:25:25.803ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76402024-11-06T00:25:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76412024-11-06T00:25:25.804ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76422024-11-06T00:25:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76432024-11-06T00:25:25.804ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
76442024-11-06T00:25:25.804ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.594127ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
76452024-11-06T00:25:25.804ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
76462024-11-06T00:25:25.804ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.874856ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
76472024-11-06T00:25:25.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76482024-11-06T00:25:25.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76492024-11-06T00:25:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76502024-11-06T00:25:25.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76512024-11-06T00:25:25.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76522024-11-06T00:25:25.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76532024-11-06T00:25:25.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76542024-11-06T00:25:25.810ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.010918ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
76552024-11-06T00:25:25.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
76562024-11-06T00:25:25.810ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76572024-11-06T00:25:25.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76582024-11-06T00:25:25.812ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-06 00:15:25.802479386 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
76592024-11-06T00:25:25.812ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.376148ms iteration = 7 status = {"expiration":"2024-11-06T00:15:25.802479386Z","pruned":[]}
76602024-11-06T00:25:25.813ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76612024-11-06T00:25:25.813ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1389, tv_nsec: 156502071 } })
76622024-11-06T00:25:25.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76632024-11-06T00:25:25.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
76642024-11-06T00:25:25.814ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76652024-11-06T00:25:25.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76662024-11-06T00:25:25.815ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
76672024-11-06T00:25:25.815ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
76682024-11-06T00:25:25.815ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 12.748699ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
76692024-11-06T00:25:25.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76702024-11-06T00:25:25.816ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1389, tv_nsec: 159289833 } })
76712024-11-06T00:25:25.816ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
76722024-11-06T00:25:25.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76732024-11-06T00:25:25.817ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76742024-11-06T00:25:25.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76752024-11-06T00:25:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76762024-11-06T00:25:25.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76772024-11-06T00:25:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76782024-11-06T00:25:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76792024-11-06T00:25:25.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76802024-11-06T00:25:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76812024-11-06T00:25:25.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76822024-11-06T00:25:25.820ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76832024-11-06T00:25:25.820ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
76842024-11-06T00:25:25.820ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76852024-11-06T00:25:25.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76862024-11-06T00:25:25.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76872024-11-06T00:25:25.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76882024-11-06T00:25:25.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
76892024-11-06T00:25:25.821ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76902024-11-06T00:25:25.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76912024-11-06T00:25:25.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76922024-11-06T00:25:25.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76932024-11-06T00:25:25.824ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76942024-11-06T00:25:25.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76952024-11-06T00:25:25.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76962024-11-06T00:25:25.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76972024-11-06T00:25:25.825ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.642552ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
76982024-11-06T00:25:25.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76992024-11-06T00:25:25.827ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77002024-11-06T00:25:25.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77012024-11-06T00:25:25.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77022024-11-06T00:25:25.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77032024-11-06T00:25:25.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77042024-11-06T00:25:25.829ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77052024-11-06T00:25:25.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77062024-11-06T00:25:25.831ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77072024-11-06T00:25:25.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77082024-11-06T00:25:25.831ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77092024-11-06T00:25:25.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77102024-11-06T00:25:25.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77112024-11-06T00:25:25.833ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77122024-11-06T00:25:25.833ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77132024-11-06T00:25:25.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77142024-11-06T00:25:25.833ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77152024-11-06T00:25:25.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77162024-11-06T00:25:25.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77172024-11-06T00:25:25.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77182024-11-06T00:25:25.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77192024-11-06T00:25:25.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77202024-11-06T00:25:25.835ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77212024-11-06T00:25:25.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77222024-11-06T00:25:25.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77232024-11-06T00:25:25.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77242024-11-06T00:25:25.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77252024-11-06T00:25:25.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77262024-11-06T00:25:25.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77272024-11-06T00:25:25.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77282024-11-06T00:25:25.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77292024-11-06T00:25:25.841ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1389, tv_nsec: 183931775 } })
77302024-11-06T00:25:25.841ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
77312024-11-06T00:25:25.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77322024-11-06T00:25:25.844ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
77332024-11-06T00:25:25.844ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
77342024-11-06T00:25:25.844ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
77352024-11-06T00:25:25.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77362024-11-06T00:25:25.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77372024-11-06T00:25:25.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77382024-11-06T00:25:25.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77392024-11-06T00:25:25.855ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 52.480378ms iteration = 4 status = {"nsuccess":5}
77402024-11-06T00:25:25.856ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
77412024-11-06T00:25:25.856ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 53.505358ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
77422024-11-06T00:25:25.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77432024-11-06T00:25:25.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77442024-11-06T00:25:25.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77452024-11-06T00:25:25.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77462024-11-06T00:25:25.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77472024-11-06T00:25:25.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77482024-11-06T00:25:25.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77492024-11-06T00:25:25.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77502024-11-06T00:25:25.860ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77512024-11-06T00:25:25.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77522024-11-06T00:25:25.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77532024-11-06T00:25:25.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77542024-11-06T00:25:25.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
77552024-11-06T00:25:25.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77562024-11-06T00:25:25.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77572024-11-06T00:25:25.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
77582024-11-06T00:25:25.863ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
77592024-11-06T00:25:25.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
77602024-11-06T00:25:25.867ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77612024-11-06T00:25:25.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77622024-11-06T00:25:25.871ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 68.485673ms iteration = 15 status = {"physical_disks_added":0}
77632024-11-06T00:25:25.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
77642024-11-06T00:25:25.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.76797ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
77652024-11-06T00:25:25.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.251904ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77662024-11-06T00:25:25.877ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77672024-11-06T00:25:25.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77682024-11-06T00:25:25.879ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77692024-11-06T00:25:25.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77702024-11-06T00:25:25.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77712024-11-06T00:25:25.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77722024-11-06T00:25:25.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77732024-11-06T00:25:25.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77742024-11-06T00:25:25.882ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
77752024-11-06T00:25:25.882ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
77762024-11-06T00:25:25.882ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
77772024-11-06T00:25:25.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77782024-11-06T00:25:25.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77792024-11-06T00:25:25.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77802024-11-06T00:25:25.883ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77812024-11-06T00:25:25.883ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
77822024-11-06T00:25:25.883ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77832024-11-06T00:25:25.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77842024-11-06T00:25:25.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77852024-11-06T00:25:25.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77862024-11-06T00:25:25.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77872024-11-06T00:25:25.885ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77882024-11-06T00:25:25.885ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77892024-11-06T00:25:25.885ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 83.037125ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
77902024-11-06T00:25:25.886ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77912024-11-06T00:25:25.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77922024-11-06T00:25:25.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77932024-11-06T00:25:25.887ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77942024-11-06T00:25:25.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77952024-11-06T00:25:25.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77962024-11-06T00:25:25.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77972024-11-06T00:25:25.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77982024-11-06T00:25:25.890ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
77992024-11-06T00:25:25.890ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
78002024-11-06T00:25:25.890ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78012024-11-06T00:25:25.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78022024-11-06T00:25:25.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
78032024-11-06T00:25:25.891ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78042024-11-06T00:25:25.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78052024-11-06T00:25:25.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
78062024-11-06T00:25:25.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78072024-11-06T00:25:25.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78082024-11-06T00:25:25.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78092024-11-06T00:25:25.894ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78102024-11-06T00:25:25.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78112024-11-06T00:25:25.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78122024-11-06T00:25:25.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78132024-11-06T00:25:25.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78142024-11-06T00:25:25.906ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
78152024-11-06T00:25:25.906ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
78162024-11-06T00:25:25.906ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 103.857473ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
78172024-11-06T00:25:25.907ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
78182024-11-06T00:25:25.907ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
78192024-11-06T00:25:25.907ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
78202024-11-06T00:25:25.907ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78212024-11-06T00:25:25.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
78222024-11-06T00:25:25.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78232024-11-06T00:25:25.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.285026ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78242024-11-06T00:25:26.002ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
78252024-11-06T00:25:26.002ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78262024-11-06T00:25:26.002ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "61e97411-3ac9-4585-bd80-ac649e68482a", "content-length": "26", "date": "Wed, 06 Nov 2024 00:25:25 GMT"} })
78272024-11-06T00:25:26.002ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78282024-11-06T00:25:26.004ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
78292024-11-06T00:25:26.070ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
78302024-11-06T00:25:26.110ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
78312024-11-06T00:25:26.111ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ed7d8a8-ac00-4798-84bc-c9c38765c9c0", "content-length": "691", "date": "Wed, 06 Nov 2024 00:25:25 GMT"} })
78322024-11-06T00:25:26.111ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
78332024-11-06T00:25:26.111ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
78342024-11-06T00:25:26.111ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
78352024-11-06T00:25:26.112ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78362024-11-06T00:25:26.113ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 310.257682ms iteration = 13 status = 0
78372024-11-06T00:25:26.113ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
78382024-11-06T00:25:26.113ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 310.726825ms iteration = 13 status = {}
78392024-11-06T00:25:26.113ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
78402024-11-06T00:25:26.113ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
78412024-11-06T00:25:26.113ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-06 00:19:33.391850 UTC dns_group = external generation = 2
78422024-11-06T00:25:26.113ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 310.89387ms iteration = 8 status = {"generation":2}
78432024-11-06T00:25:26.114ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
78442024-11-06T00:25:26.114ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78452024-11-06T00:25:26.114ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78462024-11-06T00:25:26.114ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ccc211c-f0ed-4847-8daf-ab6437415bd3", "content-length": "372", "date": "Wed, 06 Nov 2024 00:25:25 GMT"} })
78472024-11-06T00:25:26.114ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78482024-11-06T00:25:26.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78492024-11-06T00:25:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78502024-11-06T00:25:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78512024-11-06T00:25:26.142ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
78522024-11-06T00:25:26.142ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78532024-11-06T00:25:26.142ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "97b5de45-9515-4123-bcef-94466bb11ecc", "content-length": "26", "date": "Wed, 06 Nov 2024 00:25:25 GMT"} })
78542024-11-06T00:25:26.142ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78552024-11-06T00:25:26.144ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78562024-11-06T00:25:26.155ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-06T00:19:22.736570Z, time_modified: 2024-11-06T00:19:22.736570Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }) }
78572024-11-06T00:25:26.155ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 352.533626ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]}},"default_endpoint":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
78582024-11-06T00:25:26.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78592024-11-06T00:25:26.162ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
78602024-11-06T00:25:26.162ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
78612024-11-06T00:25:26.162ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "33389a5d-e3d9-4aa7-a442-4b9276e5086b", "date": "Wed, 06 Nov 2024 00:25:25 GMT"} })
78622024-11-06T00:25:26.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78632024-11-06T00:25:26.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78642024-11-06T00:25:26.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78652024-11-06T00:25:26.163ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78662024-11-06T00:25:26.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78672024-11-06T00:25:26.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78682024-11-06T00:25:26.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78692024-11-06T00:25:26.166ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
78702024-11-06T00:25:26.166ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
78712024-11-06T00:25:26.166ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-06 00:19:32.804378 UTC dns_group = internal generation = 1
78722024-11-06T00:25:26.166ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 364.09521ms iteration = 8 status = {"generation":1}
78732024-11-06T00:25:26.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78742024-11-06T00:25:26.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78752024-11-06T00:25:26.171ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
78762024-11-06T00:25:26.171ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78772024-11-06T00:25:26.171ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7064a1d9-bda1-40ea-b076-9c9e4370b1e5", "content-length": "26", "date": "Wed, 06 Nov 2024 00:25:25 GMT"} })
78782024-11-06T00:25:26.171ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78792024-11-06T00:25:26.172ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
78802024-11-06T00:25:26.172ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78812024-11-06T00:25:26.172ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5e8c316f-9039-4dca-bef8-85a3f11a7e7f", "date": "Wed, 06 Nov 2024 00:25:25 GMT"} })
78822024-11-06T00:25:26.173ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78832024-11-06T00:25:26.174ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 371.673435ms iteration = 14 status = {}
78842024-11-06T00:25:26.220ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
78852024-11-06T00:25:26.220ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 417.752543ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
78862024-11-06T00:25:26.263ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
78872024-11-06T00:25:26.276ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
78882024-11-06T00:25:26.277ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "441eca29-2e8c-42c0-b109-416dc02b95ea", "date": "Wed, 06 Nov 2024 00:25:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78892024-11-06T00:25:26.277ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78902024-11-06T00:25:26.278ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "828a771a-a9af-4935-b685-9e48b4c4b8bb", "date": "Wed, 06 Nov 2024 00:25:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78912024-11-06T00:25:26.278ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78922024-11-06T00:25:26.282ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 480.128735ms iteration = 13 status = {}
78932024-11-06T00:25:26.283ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78942024-11-06T00:25:26.283ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 480.677141ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
78952024-11-06T00:25:26.296ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78962024-11-06T00:25:26.296ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4061132a-7afd-4708-b4ea-b65ec9a9ab84", "content-length": "1", "date": "Wed, 06 Nov 2024 00:25:26 GMT"} })
78972024-11-06T00:25:26.297ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78982024-11-06T00:25:26.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78992024-11-06T00:25:26.300ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 497.391137ms iteration = 13 status = null
79002024-11-06T00:25:26.336ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
79012024-11-06T00:25:26.337ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f5cbdaf4-22f9-4813-8cae-6a86a39a92f1", "date": "Wed, 06 Nov 2024 00:25:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79022024-11-06T00:25:26.337ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79032024-11-06T00:25:26.339ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "793e2658-bc35-4fa8-97fe-6ba41f2f91ba", "date": "Wed, 06 Nov 2024 00:25:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79042024-11-06T00:25:26.339ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79052024-11-06T00:25:26.340ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9984ef88-dc46-4ac7-8c9b-55bedf11d7a1", "date": "Wed, 06 Nov 2024 00:25:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79062024-11-06T00:25:26.340ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79072024-11-06T00:25:26.342ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79082024-11-06T00:25:26.342ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 540.231619ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
79092024-11-06T00:25:26.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79102024-11-06T00:25:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79112024-11-06T00:25:26.350ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
79122024-11-06T00:25:26.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79132024-11-06T00:25:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79142024-11-06T00:25:26.359ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
79152024-11-06T00:25:26.359ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8996022e-035f-4430-87c9-70db1547692e", "content-length": "121", "date": "Wed, 06 Nov 2024 00:25:26 GMT"} })
79162024-11-06T00:25:26.359ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
79172024-11-06T00:25:26.359ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
79182024-11-06T00:25:26.359ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
79192024-11-06T00:25:26.359ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
79202024-11-06T00:25:26.360ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79212024-11-06T00:25:26.360ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79222024-11-06T00:25:26.360ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79232024-11-06T00:25:26.360ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79242024-11-06T00:25:26.360ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79252024-11-06T00:25:26.360ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79262024-11-06T00:25:26.360ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
79272024-11-06T00:25:26.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79282024-11-06T00:25:26.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79292024-11-06T00:25:26.362ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
79302024-11-06T00:25:26.362ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "18e67fbe-25bf-4930-b4ce-396f29ed495d", "content-length": "2", "date": "Wed, 06 Nov 2024 00:25:26 GMT"} })
79312024-11-06T00:25:26.362ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
79322024-11-06T00:25:26.362ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "78bae82b-6897-4daf-b4a4-0224b83917e9", "content-length": "52", "date": "Wed, 06 Nov 2024 00:25:26 GMT"} })
79332024-11-06T00:25:26.362ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
79342024-11-06T00:25:26.362ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
79352024-11-06T00:25:26.460ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a65c522e-7f05-426a-952f-2a70e1f844c0", "date": "Wed, 06 Nov 2024 00:25:25 GMT"} })
79362024-11-06T00:25:26.460ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
79372024-11-06T00:25:26.460ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
79382024-11-06T00:25:26.460ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "13763291-3bbc-4244-99b7-ff139c3adde2", "content-length": "669", "date": "Wed, 06 Nov 2024 00:25:25 GMT"} })
79392024-11-06T00:25:26.460ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79402024-11-06T00:25:26.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79412024-11-06T00:25:26.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79422024-11-06T00:25:26.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79432024-11-06T00:25:26.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79442024-11-06T00:25:26.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79452024-11-06T00:25:26.469ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79462024-11-06T00:25:26.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79472024-11-06T00:25:26.476ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 673.823405ms iteration = 13 status = {}
79482024-11-06T00:25:30.114ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:61747
79492024-11-06T00:25:30.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61747 req_id = 5f2e5e5f-226b-4bf9-bba0-b843be9c2f6c roles = RoleSet { roles: {} } uri = /metrics/producers
79502024-11-06T00:25:30.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61747 req_id = 5f2e5e5f-226b-4bf9-bba0-b843be9c2f6c resource = Database result = Ok(()) uri = /metrics/producers
79512024-11-06T00:25:30.157ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = 7c647f25-eb29-494d-840d-11658133af45
79522024-11-06T00:25:30.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43459 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61747 req_id = 5f2e5e5f-226b-4bf9-bba0-b843be9c2f6c response_code = 201 uri = /metrics/producers
79532024-11-06T00:25:31.474ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1220 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = b6063302-169d-4607-a1c7-aa02b0796e40 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
79542024-11-06T00:25:35.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
79552024-11-06T00:25:35.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79562024-11-06T00:25:35.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
79572024-11-06T00:25:35.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79582024-11-06T00:25:35.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79592024-11-06T00:25:35.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79602024-11-06T00:25:35.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79612024-11-06T00:25:35.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79622024-11-06T00:25:35.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79632024-11-06T00:25:35.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79642024-11-06T00:25:35.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79652024-11-06T00:25:35.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79662024-11-06T00:25:35.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79672024-11-06T00:25:35.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
79682024-11-06T00:25:35.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79692024-11-06T00:25:35.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79702024-11-06T00:25:35.826ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
79712024-11-06T00:25:35.826ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.758875ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
79722024-11-06T00:25:35.831ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79732024-11-06T00:25:35.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79742024-11-06T00:25:35.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.359753ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79752024-11-06T00:25:45.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
79762024-11-06T00:25:45.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79772024-11-06T00:25:45.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
79782024-11-06T00:25:45.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79792024-11-06T00:25:45.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79802024-11-06T00:25:45.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79812024-11-06T00:25:45.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79822024-11-06T00:25:45.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79832024-11-06T00:25:45.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79842024-11-06T00:25:45.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79852024-11-06T00:25:45.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79862024-11-06T00:25:45.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79872024-11-06T00:25:45.831ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79882024-11-06T00:25:45.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79892024-11-06T00:25:45.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.728802ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79902024-11-06T00:25:45.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79912024-11-06T00:25:45.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
79922024-11-06T00:25:45.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79932024-11-06T00:25:45.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79942024-11-06T00:25:45.858ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
79952024-11-06T00:25:45.858ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.079375ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
79962024-11-06T00:25:46.474ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1560 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 3bbbcb92-8d44-4f0e-b709-2b237ed51060 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
79972024-11-06T00:25:51.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 9510cb62-1d4c-4924-a40d-9cc1d3b7397f roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
79982024-11-06T00:25:51.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 9510cb62-1d4c-4924-a40d-9cc1d3b7397f resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
79992024-11-06T00:25:51.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 9510cb62-1d4c-4924-a40d-9cc1d3b7397f response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
80002024-11-06T00:25:51.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 40575379-2210-4dc2-9c70-6c4b2b6bee4a roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
80012024-11-06T00:25:51.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 40575379-2210-4dc2-9c70-6c4b2b6bee4a resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
80022024-11-06T00:25:51.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1928 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 40575379-2210-4dc2-9c70-6c4b2b6bee4a response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
80032024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
80042024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 23.61\u{b5}s iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
80052024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
80062024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
80072024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
80082024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80092024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
80102024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80112024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
80122024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
80132024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 16.001\u{b5}s iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
80142024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80152024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80162024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
80172024-11-06T00:25:55.802ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
80182024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
80192024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80202024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.991\u{b5}s iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
80212024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
80222024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
80232024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80242024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80252024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
80262024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80272024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80282024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
80292024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
80302024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
80312024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
80322024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80332024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
80342024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80352024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.54\u{b5}s iteration = 14 status = {"errors":[],"records_set_to_done":[]}
80362024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
80372024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80382024-11-06T00:25:55.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80392024-11-06T00:25:55.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80402024-11-06T00:25:55.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80412024-11-06T00:25:55.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80422024-11-06T00:25:55.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80432024-11-06T00:25:55.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80442024-11-06T00:25:55.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80452024-11-06T00:25:55.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80462024-11-06T00:25:55.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80472024-11-06T00:25:55.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80482024-11-06T00:25:55.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
80492024-11-06T00:25:55.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80502024-11-06T00:25:55.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80512024-11-06T00:25:55.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.960468ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80522024-11-06T00:25:55.805ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80532024-11-06T00:25:55.805ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
80542024-11-06T00:25:55.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80552024-11-06T00:25:55.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80562024-11-06T00:25:55.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80572024-11-06T00:25:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
80582024-11-06T00:25:55.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80592024-11-06T00:25:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80602024-11-06T00:25:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80612024-11-06T00:25:55.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80622024-11-06T00:25:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80632024-11-06T00:25:55.809ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1419, tv_nsec: 152301386 } })
80642024-11-06T00:25:55.809ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
80652024-11-06T00:25:55.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80662024-11-06T00:25:55.810ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80672024-11-06T00:25:55.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80682024-11-06T00:25:55.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80692024-11-06T00:25:55.811ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1419, tv_nsec: 154238744 } })
80702024-11-06T00:25:55.811ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
80712024-11-06T00:25:55.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80722024-11-06T00:25:55.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80732024-11-06T00:25:55.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80742024-11-06T00:25:55.813ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80752024-11-06T00:25:55.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80762024-11-06T00:25:55.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80772024-11-06T00:25:55.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80782024-11-06T00:25:55.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80792024-11-06T00:25:55.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80802024-11-06T00:25:55.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80812024-11-06T00:25:55.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80822024-11-06T00:25:55.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80832024-11-06T00:25:55.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80842024-11-06T00:25:55.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80852024-11-06T00:25:55.816ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80862024-11-06T00:25:55.816ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80872024-11-06T00:25:55.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80882024-11-06T00:25:55.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80892024-11-06T00:25:55.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80902024-11-06T00:25:55.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80912024-11-06T00:25:55.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80922024-11-06T00:25:55.817ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1419, tv_nsec: 161198400 } })
80932024-11-06T00:25:55.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80942024-11-06T00:25:55.818ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
80952024-11-06T00:25:55.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80962024-11-06T00:25:55.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80972024-11-06T00:25:55.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80982024-11-06T00:25:55.819ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80992024-11-06T00:25:55.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81002024-11-06T00:25:55.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81012024-11-06T00:25:55.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81022024-11-06T00:25:55.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
81032024-11-06T00:25:55.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81042024-11-06T00:25:55.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81052024-11-06T00:25:55.840ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
81062024-11-06T00:25:55.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.866464ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
81072024-11-06T00:25:55.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81082024-11-06T00:25:55.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81092024-11-06T00:25:55.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81102024-11-06T00:25:55.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81112024-11-06T00:25:55.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81122024-11-06T00:25:55.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81132024-11-06T00:25:55.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81142024-11-06T00:25:55.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81152024-11-06T00:25:55.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.779978ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
81162024-11-06T00:25:55.851ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81172024-11-06T00:25:55.851ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
81182024-11-06T00:25:55.851ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 49.102818ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
81192024-11-06T00:25:55.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81202024-11-06T00:25:55.853ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
81212024-11-06T00:25:55.853ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 51.032615ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
81222024-11-06T00:25:55.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81232024-11-06T00:25:55.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81242024-11-06T00:25:55.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81252024-11-06T00:25:55.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.096347ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81262024-11-06T00:25:55.888ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81272024-11-06T00:25:55.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
81282024-11-06T00:25:55.891ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81292024-11-06T00:25:55.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81302024-11-06T00:25:55.893ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 90.518877ms iteration = 14 status = 0
81312024-11-06T00:25:55.928ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81322024-11-06T00:25:55.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81332024-11-06T00:25:55.957ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 155.469845ms iteration = 16 status = {"physical_disks_added":0}
81342024-11-06T00:25:55.958ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81352024-11-06T00:25:55.960ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81362024-11-06T00:25:55.960ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81372024-11-06T00:25:55.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81382024-11-06T00:25:55.967ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
81392024-11-06T00:25:55.967ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81402024-11-06T00:25:55.968ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb06efca-5b41-4eb4-ba5a-e6fda0bbee56", "content-length": "26", "date": "Wed, 06 Nov 2024 00:25:55 GMT"} })
81412024-11-06T00:25:55.968ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81422024-11-06T00:25:55.969ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
81432024-11-06T00:25:55.995ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81442024-11-06T00:25:55.997ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81452024-11-06T00:25:55.997ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81462024-11-06T00:25:55.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81472024-11-06T00:25:56.042ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
81482024-11-06T00:25:56.042ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81492024-11-06T00:25:56.042ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a389831b-8e35-42a2-af72-cd17f53dd230", "content-length": "26", "date": "Wed, 06 Nov 2024 00:25:55 GMT"} })
81502024-11-06T00:25:56.042ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81512024-11-06T00:25:56.044ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81522024-11-06T00:25:56.045ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
81532024-11-06T00:25:56.045ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81542024-11-06T00:25:56.045ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fd937a5-34ce-4752-a2d0-46eab11b4efb", "content-length": "26", "date": "Wed, 06 Nov 2024 00:25:55 GMT"} })
81552024-11-06T00:25:56.045ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81562024-11-06T00:25:56.047ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81572024-11-06T00:25:56.064ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
81582024-11-06T00:25:56.064ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81592024-11-06T00:25:56.064ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b06468a1-8200-439c-a740-87e1ce1cd179", "content-length": "372", "date": "Wed, 06 Nov 2024 00:25:55 GMT"} })
81602024-11-06T00:25:56.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81612024-11-06T00:25:56.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81622024-11-06T00:25:56.105ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
81632024-11-06T00:25:56.105ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
81642024-11-06T00:25:56.106ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8d82e103-4f98-407b-86e9-2d7639c9116b", "date": "Wed, 06 Nov 2024 00:25:55 GMT"} })
81652024-11-06T00:25:56.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81662024-11-06T00:25:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81672024-11-06T00:25:56.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81682024-11-06T00:25:56.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81692024-11-06T00:25:56.178ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 375.970312ms iteration = 14 status = {}
81702024-11-06T00:25:56.183ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81712024-11-06T00:25:56.183ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2be08ec2-350f-402d-8c3c-d98ac8d01ef8", "content-length": "691", "date": "Wed, 06 Nov 2024 00:25:55 GMT"} })
81722024-11-06T00:25:56.184ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
81732024-11-06T00:25:56.184ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
81742024-11-06T00:25:56.184ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
81752024-11-06T00:25:56.185ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 383.202677ms iteration = 14 status = {}
81762024-11-06T00:25:56.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81772024-11-06T00:25:56.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81782024-11-06T00:25:56.191ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81792024-11-06T00:25:56.191ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81802024-11-06T00:25:56.191ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "764911ed-0103-4a62-b455-773b9b57d4f4", "date": "Wed, 06 Nov 2024 00:25:55 GMT"} })
81812024-11-06T00:25:56.192ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 389.975748ms iteration = 15 status = {}
81822024-11-06T00:25:56.245ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81832024-11-06T00:25:56.245ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ee4c6a4-7a44-4f94-a3dd-eaba3fcdc09e", "content-length": "1", "date": "Wed, 06 Nov 2024 00:25:55 GMT"} })
81842024-11-06T00:25:56.247ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81852024-11-06T00:25:56.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81862024-11-06T00:25:56.250ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 447.948379ms iteration = 14 status = null
81872024-11-06T00:25:56.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81882024-11-06T00:25:56.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81892024-11-06T00:25:56.289ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
81902024-11-06T00:25:56.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81912024-11-06T00:25:56.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81922024-11-06T00:25:56.298ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
81932024-11-06T00:25:56.298ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fad1803-5fb7-47be-9b3f-a007d58d2c04", "content-length": "121", "date": "Wed, 06 Nov 2024 00:25:56 GMT"} })
81942024-11-06T00:25:56.298ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
81952024-11-06T00:25:56.298ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
81962024-11-06T00:25:56.298ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
81972024-11-06T00:25:56.298ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81982024-11-06T00:25:56.298ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81992024-11-06T00:25:56.298ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82002024-11-06T00:25:56.298ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82012024-11-06T00:25:56.298ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82022024-11-06T00:25:56.298ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82032024-11-06T00:25:56.298ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82042024-11-06T00:25:56.299ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
82052024-11-06T00:25:56.299ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82062024-11-06T00:25:56.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82072024-11-06T00:25:56.301ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
82082024-11-06T00:25:56.301ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "56ce09d0-e031-4845-a437-a67a238c951b", "content-length": "2", "date": "Wed, 06 Nov 2024 00:25:56 GMT"} })
82092024-11-06T00:25:56.301ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
82102024-11-06T00:25:56.301ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "22905e17-d23c-4ccb-9c92-29548306934d", "content-length": "52", "date": "Wed, 06 Nov 2024 00:25:56 GMT"} })
82112024-11-06T00:25:56.301ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
82122024-11-06T00:25:56.301ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
82132024-11-06T00:25:56.394ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "76f58fc1-eab4-457e-8e14-16999ff01cb8", "date": "Wed, 06 Nov 2024 00:25:55 GMT"} })
82142024-11-06T00:25:56.394ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
82152024-11-06T00:25:56.394ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
82162024-11-06T00:25:56.394ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ce4d09b-bae5-478d-8c63-0a46476bad7b", "content-length": "669", "date": "Wed, 06 Nov 2024 00:25:55 GMT"} })
82172024-11-06T00:25:56.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82182024-11-06T00:25:56.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82192024-11-06T00:25:56.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82202024-11-06T00:25:56.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82212024-11-06T00:25:56.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82222024-11-06T00:25:56.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82232024-11-06T00:25:56.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82242024-11-06T00:25:56.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82252024-11-06T00:25:56.410ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 608.172126ms iteration = 14 status = {}
82262024-11-06T00:25:59.029ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48164
82272024-11-06T00:25:59.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48164 req_id = c3c9d9bf-d0c3-4f18-97c0-04ac2ee9d948 roles = RoleSet { roles: {} } uri = /metrics/producers
82282024-11-06T00:25:59.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48164 req_id = c3c9d9bf-d0c3-4f18-97c0-04ac2ee9d948 resource = Database result = Ok(()) uri = /metrics/producers
82292024-11-06T00:25:59.066ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = eeaea349-a304-4c2f-97f2-4ab76b77beee
82302024-11-06T00:25:59.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36854 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48164 req_id = c3c9d9bf-d0c3-4f18-97c0-04ac2ee9d948 response_code = 201 uri = /metrics/producers
82312024-11-06T00:26:01.472ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1734 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 1c2fbd6d-9bd7-4d8c-9763-d74bd2f9073f response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
82322024-11-06T00:26:05.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
82332024-11-06T00:26:05.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82342024-11-06T00:26:05.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
82352024-11-06T00:26:05.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82362024-11-06T00:26:05.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82372024-11-06T00:26:05.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82382024-11-06T00:26:05.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82392024-11-06T00:26:05.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82402024-11-06T00:26:05.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82412024-11-06T00:26:05.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82422024-11-06T00:26:05.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82432024-11-06T00:26:05.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82442024-11-06T00:26:05.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82452024-11-06T00:26:05.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
82462024-11-06T00:26:05.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82472024-11-06T00:26:05.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82482024-11-06T00:26:05.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
82492024-11-06T00:26:05.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.250931ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
82502024-11-06T00:26:05.830ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82512024-11-06T00:26:05.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82522024-11-06T00:26:05.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.93814ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82532024-11-06T00:26:15.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
82542024-11-06T00:26:15.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82552024-11-06T00:26:15.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
82562024-11-06T00:26:15.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82572024-11-06T00:26:15.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82582024-11-06T00:26:15.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82592024-11-06T00:26:15.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82602024-11-06T00:26:15.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82612024-11-06T00:26:15.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82622024-11-06T00:26:15.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82632024-11-06T00:26:15.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82642024-11-06T00:26:15.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82652024-11-06T00:26:15.836ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82662024-11-06T00:26:15.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82672024-11-06T00:26:15.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82682024-11-06T00:26:15.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.976178ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82692024-11-06T00:26:15.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
82702024-11-06T00:26:15.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82712024-11-06T00:26:15.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82722024-11-06T00:26:15.851ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
82732024-11-06T00:26:15.851ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.576602ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
82742024-11-06T00:26:16.473ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1377 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 6bfe2b71-309e-454e-aa24-b19a37acd527 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
82752024-11-06T00:26:19.788ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:63787
82762024-11-06T00:26:19.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63787 req_id = a1bd0308-925e-4804-a1c7-99c435553526 roles = RoleSet { roles: {} } uri = /metrics/producers
82772024-11-06T00:26:19.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63787 req_id = a1bd0308-925e-4804-a1c7-99c435553526 resource = Database result = Ok(()) uri = /metrics/producers
82782024-11-06T00:26:19.836ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = 9c1a1f66-8a95-49da-beda-497b56ec3bbf
82792024-11-06T00:26:19.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47117 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63787 req_id = a1bd0308-925e-4804-a1c7-99c435553526 response_code = 201 uri = /metrics/producers
82802024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
82812024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82822024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
82832024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
82842024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
82852024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
82862024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.001\u{b5}s iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
82872024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
82882024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
82892024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
82902024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82912024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
82922024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
82932024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
82942024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
82952024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82962024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
82972024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82982024-11-06T00:26:25.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
82992024-11-06T00:26:25.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846
83002024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
83012024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.72\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846"}
83022024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83032024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
83042024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
83052024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.69\u{b5}s iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
83062024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
83072024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.73\u{b5}s iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
83082024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
83092024-11-06T00:26:25.802ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
83102024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
83112024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
83122024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83132024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83142024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
83152024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
83162024-11-06T00:26:25.802ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-06 00:16:25.801993496 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
83172024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
83182024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83192024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
83202024-11-06T00:26:25.802ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
83212024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
83222024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
83232024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
83242024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
83252024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83262024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
83272024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83282024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
83292024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83302024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
83312024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83322024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
83332024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83342024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
83352024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
83362024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.431\u{b5}s iteration = 15 status = {"errors":[],"records_set_to_done":[]}
83372024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
83382024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83392024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
83402024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
83412024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
83422024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83432024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83442024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
83452024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
83462024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83472024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83482024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
83492024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83502024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83512024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83522024-11-06T00:26:25.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("309c9aef-da72-4f08-9f70-c20d80316472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1449, tv_nsec: 146253807 } })
83532024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
83542024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83552024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83562024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83572024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83582024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83592024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83602024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
83612024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83622024-11-06T00:26:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
83632024-11-06T00:26:25.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51df9631-cef5-49ae-8cfd-f0c05bdac388.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7102227a-61f8-4dda-a9a0-f6678fae71c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1449, tv_nsec: 146387141 } })
83642024-11-06T00:26:25.803ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
83652024-11-06T00:26:25.803ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.142504ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
83662024-11-06T00:26:25.803ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
83672024-11-06T00:26:25.803ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.252697ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
83682024-11-06T00:26:25.804ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83692024-11-06T00:26:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83702024-11-06T00:26:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.571145ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83712024-11-06T00:26:25.807ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.909155ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
83722024-11-06T00:26:25.809ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-06 00:16:25.801993496 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
83732024-11-06T00:26:25.809ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.442781ms iteration = 8 status = {"expiration":"2024-11-06T00:16:25.801993496Z","pruned":[]}
83742024-11-06T00:26:25.812ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83752024-11-06T00:26:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83762024-11-06T00:26:25.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83772024-11-06T00:26:25.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83782024-11-06T00:26:25.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83792024-11-06T00:26:25.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83802024-11-06T00:26:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83812024-11-06T00:26:25.818ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1449, tv_nsec: 162357535 } })
83822024-11-06T00:26:25.819ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
83832024-11-06T00:26:25.820ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1449, tv_nsec: 164045255 } })
83842024-11-06T00:26:25.820ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
83852024-11-06T00:26:25.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83862024-11-06T00:26:25.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83872024-11-06T00:26:25.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83882024-11-06T00:26:25.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83892024-11-06T00:26:25.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83902024-11-06T00:26:25.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83912024-11-06T00:26:25.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
83922024-11-06T00:26:25.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83932024-11-06T00:26:25.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83942024-11-06T00:26:25.849ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83952024-11-06T00:26:25.851ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83962024-11-06T00:26:25.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
83972024-11-06T00:26:25.851ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
83982024-11-06T00:26:25.851ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
83992024-11-06T00:26:25.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84002024-11-06T00:26:25.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
84012024-11-06T00:26:25.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84022024-11-06T00:26:25.858ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84032024-11-06T00:26:25.858ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
84042024-11-06T00:26:25.858ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84052024-11-06T00:26:25.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84062024-11-06T00:26:25.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84072024-11-06T00:26:25.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84082024-11-06T00:26:25.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
84092024-11-06T00:26:25.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84102024-11-06T00:26:25.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84112024-11-06T00:26:25.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
84122024-11-06T00:26:25.867ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84132024-11-06T00:26:25.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84142024-11-06T00:26:25.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84152024-11-06T00:26:25.869ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84162024-11-06T00:26:25.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84172024-11-06T00:26:25.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84182024-11-06T00:26:25.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84192024-11-06T00:26:25.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84202024-11-06T00:26:25.871ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84212024-11-06T00:26:25.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84222024-11-06T00:26:25.871ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84232024-11-06T00:26:25.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84242024-11-06T00:26:25.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84252024-11-06T00:26:25.873ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
84262024-11-06T00:26:25.873ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
84272024-11-06T00:26:25.873ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 71.594686ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
84282024-11-06T00:26:25.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84292024-11-06T00:26:25.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
84302024-11-06T00:26:25.874ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84312024-11-06T00:26:25.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84322024-11-06T00:26:25.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84332024-11-06T00:26:25.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84342024-11-06T00:26:25.875ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
84352024-11-06T00:26:25.875ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84362024-11-06T00:26:25.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84372024-11-06T00:26:25.875ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
84382024-11-06T00:26:25.875ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
84392024-11-06T00:26:25.875ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
84402024-11-06T00:26:25.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84412024-11-06T00:26:25.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
84422024-11-06T00:26:25.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84432024-11-06T00:26:25.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84442024-11-06T00:26:25.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84452024-11-06T00:26:25.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84462024-11-06T00:26:25.877ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1449, tv_nsec: 220901903 } })
84472024-11-06T00:26:25.877ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
84482024-11-06T00:26:25.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84492024-11-06T00:26:25.879ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84502024-11-06T00:26:25.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84512024-11-06T00:26:25.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84522024-11-06T00:26:25.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84532024-11-06T00:26:25.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84542024-11-06T00:26:25.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84552024-11-06T00:26:25.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84562024-11-06T00:26:25.881ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84572024-11-06T00:26:25.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84582024-11-06T00:26:25.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84592024-11-06T00:26:25.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84602024-11-06T00:26:25.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84612024-11-06T00:26:25.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84622024-11-06T00:26:25.888ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84632024-11-06T00:26:25.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
84642024-11-06T00:26:25.892ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84652024-11-06T00:26:25.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84662024-11-06T00:26:25.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.350682ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84672024-11-06T00:26:25.894ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
84682024-11-06T00:26:25.894ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.476376ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
84692024-11-06T00:26:25.898ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84702024-11-06T00:26:25.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84712024-11-06T00:26:25.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84722024-11-06T00:26:25.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84732024-11-06T00:26:25.904ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84742024-11-06T00:26:25.904ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84752024-11-06T00:26:25.904ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 103.05551ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84762024-11-06T00:26:25.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84772024-11-06T00:26:25.907ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
84782024-11-06T00:26:25.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
84792024-11-06T00:26:25.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
84802024-11-06T00:26:25.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84812024-11-06T00:26:25.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84822024-11-06T00:26:25.909ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
84832024-11-06T00:26:25.909ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
84842024-11-06T00:26:25.909ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 107.678977ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
84852024-11-06T00:26:25.911ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.171101ms iteration = 15 status = 0
84862024-11-06T00:26:25.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 109.891483ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84872024-11-06T00:26:25.915ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
84882024-11-06T00:26:25.915ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
84892024-11-06T00:26:25.915ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
84902024-11-06T00:26:25.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84912024-11-06T00:26:25.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84922024-11-06T00:26:25.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84932024-11-06T00:26:25.918ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84942024-11-06T00:26:25.919ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 117.105387ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
84952024-11-06T00:26:25.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84962024-11-06T00:26:25.920ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84972024-11-06T00:26:25.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84982024-11-06T00:26:25.921ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
84992024-11-06T00:26:25.922ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
85002024-11-06T00:26:25.922ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
85012024-11-06T00:26:25.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85022024-11-06T00:26:25.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85032024-11-06T00:26:25.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85042024-11-06T00:26:25.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85052024-11-06T00:26:25.928ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85062024-11-06T00:26:25.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85072024-11-06T00:26:25.930ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
85082024-11-06T00:26:25.930ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
85092024-11-06T00:26:25.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85102024-11-06T00:26:25.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85112024-11-06T00:26:25.931ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
85122024-11-06T00:26:25.931ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
85132024-11-06T00:26:25.931ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-06 00:19:32.804378 UTC dns_group = internal generation = 1
85142024-11-06T00:26:25.931ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 129.056712ms iteration = 9 status = {"generation":1}
85152024-11-06T00:26:25.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85162024-11-06T00:26:25.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85172024-11-06T00:26:25.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85182024-11-06T00:26:25.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85192024-11-06T00:26:25.937ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
85202024-11-06T00:26:25.937ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
85212024-11-06T00:26:25.937ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-06 00:19:33.391850 UTC dns_group = external generation = 2
85222024-11-06T00:26:25.937ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 135.200734ms iteration = 9 status = {"generation":2}
85232024-11-06T00:26:25.938ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85242024-11-06T00:26:25.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85252024-11-06T00:26:25.940ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85262024-11-06T00:26:25.942ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85272024-11-06T00:26:25.942ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85282024-11-06T00:26:25.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85292024-11-06T00:26:25.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85302024-11-06T00:26:25.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85312024-11-06T00:26:25.992ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-06T00:19:22.736570Z, time_modified: 2024-11-06T00:19:22.736570Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }) }
85322024-11-06T00:26:25.992ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 190.784494ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]}},"default_endpoint":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
85332024-11-06T00:26:25.998ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
85342024-11-06T00:26:25.998ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85352024-11-06T00:26:25.998ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4621f28e-9d48-4f7c-a4f9-77c1e945127e", "content-length": "26", "date": "Wed, 06 Nov 2024 00:26:25 GMT"} })
85362024-11-06T00:26:25.998ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85372024-11-06T00:26:26.001ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85382024-11-06T00:26:26.007ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 205.280094ms iteration = 17 status = {"physical_disks_added":0}
85392024-11-06T00:26:26.024ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
85402024-11-06T00:26:26.024ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 222.97788ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
85412024-11-06T00:26:26.044ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
85422024-11-06T00:26:26.044ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85432024-11-06T00:26:26.045ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2aafe6b1-2ce7-45af-a996-81b826dfab23", "content-length": "26", "date": "Wed, 06 Nov 2024 00:26:25 GMT"} })
85442024-11-06T00:26:26.045ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85452024-11-06T00:26:26.046ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
85462024-11-06T00:26:26.055ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85472024-11-06T00:26:26.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85482024-11-06T00:26:26.057ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
85492024-11-06T00:26:26.132ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
85502024-11-06T00:26:26.132ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "97a2f062-fdc2-4931-a0fa-2d4a010e7eb2", "date": "Wed, 06 Nov 2024 00:26:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85512024-11-06T00:26:26.132ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85522024-11-06T00:26:26.134ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "559b1abf-cf46-44e3-b9c3-8649a452f95a", "date": "Wed, 06 Nov 2024 00:26:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85532024-11-06T00:26:26.134ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85542024-11-06T00:26:26.135ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
85552024-11-06T00:26:26.135ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85562024-11-06T00:26:26.135ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ddf3673-0e46-458e-be53-f45e0b8dea49", "content-length": "26", "date": "Wed, 06 Nov 2024 00:26:25 GMT"} })
85572024-11-06T00:26:26.135ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85582024-11-06T00:26:26.136ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85592024-11-06T00:26:26.136ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 334.347106ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
85602024-11-06T00:26:26.137ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85612024-11-06T00:26:26.140ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
85622024-11-06T00:26:26.140ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85632024-11-06T00:26:26.150ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce6dc052-afc5-4798-a9f8-da60c3aa2ce3", "content-length": "372", "date": "Wed, 06 Nov 2024 00:26:25 GMT"} })
85642024-11-06T00:26:26.150ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85652024-11-06T00:26:26.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85662024-11-06T00:26:26.169ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
85672024-11-06T00:26:26.169ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd90d3d7-cb3c-4327-9343-e196188621f2", "content-length": "1", "date": "Wed, 06 Nov 2024 00:26:25 GMT"} })
85682024-11-06T00:26:26.171ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85692024-11-06T00:26:26.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85702024-11-06T00:26:26.175ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 373.822668ms iteration = 15 status = null
85712024-11-06T00:26:26.178ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85722024-11-06T00:26:26.183ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85732024-11-06T00:26:26.183ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85742024-11-06T00:26:26.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85752024-11-06T00:26:26.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85762024-11-06T00:26:26.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85772024-11-06T00:26:26.187ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85782024-11-06T00:26:26.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85792024-11-06T00:26:26.201ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
85802024-11-06T00:26:26.201ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
85812024-11-06T00:26:26.202ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c3435cdc-9cf8-4783-bea1-9af46e212950", "date": "Wed, 06 Nov 2024 00:26:25 GMT"} })
85822024-11-06T00:26:26.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85832024-11-06T00:26:26.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85842024-11-06T00:26:26.204ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85852024-11-06T00:26:26.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85862024-11-06T00:26:26.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85872024-11-06T00:26:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85882024-11-06T00:26:26.209ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85892024-11-06T00:26:26.209ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85902024-11-06T00:26:26.210ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fce73671-047a-4fc2-9e1b-e717ac51b73c", "date": "Wed, 06 Nov 2024 00:26:25 GMT"} })
85912024-11-06T00:26:26.212ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 410.415955ms iteration = 16 status = {}
85922024-11-06T00:26:26.226ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
85932024-11-06T00:26:26.322ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 520.012469ms iteration = 15 status = {}
85942024-11-06T00:26:26.370ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
85952024-11-06T00:26:26.371ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "631ff76a-7693-4895-a276-4feee3652118", "date": "Wed, 06 Nov 2024 00:26:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85962024-11-06T00:26:26.371ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85972024-11-06T00:26:26.374ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "544aede5-45ba-4429-a016-f5e464c2d36d", "date": "Wed, 06 Nov 2024 00:26:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85982024-11-06T00:26:26.374ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85992024-11-06T00:26:26.376ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3b6b496f-3b62-4466-8ec5-0771da6eb6c9", "date": "Wed, 06 Nov 2024 00:26:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86002024-11-06T00:26:26.376ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86012024-11-06T00:26:26.377ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
86022024-11-06T00:26:26.378ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7ff41cb-58ab-4aac-ac3d-83b1c1d02d58", "content-length": "691", "date": "Wed, 06 Nov 2024 00:26:25 GMT"} })
86032024-11-06T00:26:26.378ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
86042024-11-06T00:26:26.378ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
86052024-11-06T00:26:26.378ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
86062024-11-06T00:26:26.379ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86072024-11-06T00:26:26.379ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 577.689801ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
86082024-11-06T00:26:26.380ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 578.544777ms iteration = 15 status = {}
86092024-11-06T00:26:26.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86102024-11-06T00:26:26.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86112024-11-06T00:26:26.445ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
86122024-11-06T00:26:26.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86132024-11-06T00:26:26.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86142024-11-06T00:26:26.461ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
86152024-11-06T00:26:26.461ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0799bfd9-19ed-46ff-9991-e224d5a35a02", "content-length": "121", "date": "Wed, 06 Nov 2024 00:26:26 GMT"} })
86162024-11-06T00:26:26.461ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
86172024-11-06T00:26:26.461ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
86182024-11-06T00:26:26.461ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
86192024-11-06T00:26:26.461ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
86202024-11-06T00:26:26.461ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86212024-11-06T00:26:26.461ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86222024-11-06T00:26:26.461ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86232024-11-06T00:26:26.461ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86242024-11-06T00:26:26.462ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86252024-11-06T00:26:26.462ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86262024-11-06T00:26:26.462ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
86272024-11-06T00:26:26.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86282024-11-06T00:26:26.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86292024-11-06T00:26:26.465ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
86302024-11-06T00:26:26.465ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2115d60b-548d-49b5-8692-262cfdd11484", "content-length": "2", "date": "Wed, 06 Nov 2024 00:26:26 GMT"} })
86312024-11-06T00:26:26.465ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
86322024-11-06T00:26:26.466ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6bdd648-3326-493f-aeb8-25e180b6c4e9", "content-length": "52", "date": "Wed, 06 Nov 2024 00:26:26 GMT"} })
86332024-11-06T00:26:26.466ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
86342024-11-06T00:26:26.466ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
86352024-11-06T00:26:26.576ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3ad2db25-d9ca-46da-a664-8029403e2c4c", "date": "Wed, 06 Nov 2024 00:26:25 GMT"} })
86362024-11-06T00:26:26.576ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
86372024-11-06T00:26:26.576ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
86382024-11-06T00:26:26.576ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d78b2ac-39af-4d43-bf81-2bef3a73b455", "content-length": "669", "date": "Wed, 06 Nov 2024 00:26:25 GMT"} })
86392024-11-06T00:26:26.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86402024-11-06T00:26:26.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86412024-11-06T00:26:26.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86422024-11-06T00:26:26.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86432024-11-06T00:26:26.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86442024-11-06T00:26:26.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86452024-11-06T00:26:26.587ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86462024-11-06T00:26:26.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86472024-11-06T00:26:26.594ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 792.509678ms iteration = 15 status = {}
86482024-11-06T00:26:29.092ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:33125
86492024-11-06T00:26:29.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33125 req_id = 08e7f03c-d9d3-4bb0-b7fe-a43b45224c7c roles = RoleSet { roles: {} } uri = /metrics/producers
86502024-11-06T00:26:29.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33125 req_id = 08e7f03c-d9d3-4bb0-b7fe-a43b45224c7c resource = Database result = Ok(()) uri = /metrics/producers
86512024-11-06T00:26:29.142ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = fed3ec74-af42-4df7-9f71-3957f7103dff
86522024-11-06T00:26:29.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49599 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33125 req_id = 08e7f03c-d9d3-4bb0-b7fe-a43b45224c7c response_code = 201 uri = /metrics/producers
86532024-11-06T00:26:31.473ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1377 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = d0cdc9ca-4bcd-4e54-afc6-dae121c954ef response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
86542024-11-06T00:26:35.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
86552024-11-06T00:26:35.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86562024-11-06T00:26:35.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
86572024-11-06T00:26:35.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86582024-11-06T00:26:35.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86592024-11-06T00:26:35.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86602024-11-06T00:26:35.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86612024-11-06T00:26:35.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86622024-11-06T00:26:35.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86632024-11-06T00:26:35.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.621498ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86642024-11-06T00:26:35.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86652024-11-06T00:26:35.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86662024-11-06T00:26:35.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86672024-11-06T00:26:35.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86682024-11-06T00:26:35.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86692024-11-06T00:26:35.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86702024-11-06T00:26:35.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
86712024-11-06T00:26:35.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86722024-11-06T00:26:35.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86732024-11-06T00:26:35.823ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
86742024-11-06T00:26:35.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.107347ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
86752024-11-06T00:26:36.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = a34a9897-5443-49bb-8b54-53c948e77abf roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
86762024-11-06T00:26:36.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = a34a9897-5443-49bb-8b54-53c948e77abf resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
86772024-11-06T00:26:36.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = a34a9897-5443-49bb-8b54-53c948e77abf response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
86782024-11-06T00:26:36.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 475fb57a-a1b4-4548-93c4-6cd154ac213f roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
86792024-11-06T00:26:36.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 475fb57a-a1b4-4548-93c4-6cd154ac213f resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
86802024-11-06T00:26:36.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 475fb57a-a1b4-4548-93c4-6cd154ac213f response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
86812024-11-06T00:26:45.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
86822024-11-06T00:26:45.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86832024-11-06T00:26:45.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
86842024-11-06T00:26:45.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86852024-11-06T00:26:45.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86862024-11-06T00:26:45.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86872024-11-06T00:26:45.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86882024-11-06T00:26:45.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86892024-11-06T00:26:45.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86902024-11-06T00:26:45.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86912024-11-06T00:26:45.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86922024-11-06T00:26:45.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86932024-11-06T00:26:45.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86942024-11-06T00:26:45.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
86952024-11-06T00:26:45.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86962024-11-06T00:26:45.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86972024-11-06T00:26:45.823ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
86982024-11-06T00:26:45.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.942232ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
86992024-11-06T00:26:45.830ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87002024-11-06T00:26:45.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87012024-11-06T00:26:45.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.870339ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87022024-11-06T00:26:46.472ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1280 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = cea4b552-9648-4edb-a258-2be6c9335a79 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
87032024-11-06T00:26:55.284ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:60722
87042024-11-06T00:26:55.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60722 req_id = 6f7c004a-70f2-4830-9db0-9eb047ffba70 roles = RoleSet { roles: {} } uri = /metrics/producers
87052024-11-06T00:26:55.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60722 req_id = 6f7c004a-70f2-4830-9db0-9eb047ffba70 resource = Database result = Ok(()) uri = /metrics/producers
87062024-11-06T00:26:55.301ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = a6ef5eb9-ed97-44f5-b038-ae216d3973fd
87072024-11-06T00:26:55.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 16201 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60722 req_id = 6f7c004a-70f2-4830-9db0-9eb047ffba70 response_code = 201 uri = /metrics/producers
87082024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
87092024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87102024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
87112024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
87122024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87132024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 17.371\u{b5}s iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
87142024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
87152024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
87162024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.42\u{b5}s iteration = 16 status = {"errors":[],"records_set_to_done":[]}
87172024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
87182024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.05\u{b5}s iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
87192024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
87202024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87212024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
87222024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87232024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.691\u{b5}s iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
87242024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87252024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
87262024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
87272024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87282024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87292024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
87302024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87312024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
87322024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
87332024-11-06T00:26:55.802ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87342024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
87352024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
87362024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87372024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87382024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87392024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
87402024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87412024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
87422024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87432024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87442024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87452024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87462024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87472024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87482024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87492024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87502024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87512024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
87522024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87532024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87542024-11-06T00:26:55.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87552024-11-06T00:26:55.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.319009ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
87562024-11-06T00:26:55.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87572024-11-06T00:26:55.806ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87582024-11-06T00:26:55.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87592024-11-06T00:26:55.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87602024-11-06T00:26:55.809ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87612024-11-06T00:26:55.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87622024-11-06T00:26:55.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87632024-11-06T00:26:55.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87642024-11-06T00:26:55.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87652024-11-06T00:26:55.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
87662024-11-06T00:26:55.810ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87672024-11-06T00:26:55.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87682024-11-06T00:26:55.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87692024-11-06T00:26:55.813ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1479, tv_nsec: 157765798 } })
87702024-11-06T00:26:55.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
87712024-11-06T00:26:55.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87722024-11-06T00:26:55.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
87732024-11-06T00:26:55.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87742024-11-06T00:26:55.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87752024-11-06T00:26:55.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87762024-11-06T00:26:55.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87772024-11-06T00:26:55.819ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1479, tv_nsec: 163206230 } })
87782024-11-06T00:26:55.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87792024-11-06T00:26:55.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87802024-11-06T00:26:55.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87812024-11-06T00:26:55.819ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
87822024-11-06T00:26:55.819ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1479, tv_nsec: 163680904 } })
87832024-11-06T00:26:55.819ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
87842024-11-06T00:26:55.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87852024-11-06T00:26:55.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87862024-11-06T00:26:55.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87872024-11-06T00:26:55.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87882024-11-06T00:26:55.840ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87892024-11-06T00:26:55.840ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
87902024-11-06T00:26:55.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87912024-11-06T00:26:55.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87922024-11-06T00:26:55.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87932024-11-06T00:26:55.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87942024-11-06T00:26:55.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87952024-11-06T00:26:55.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87962024-11-06T00:26:55.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87972024-11-06T00:26:55.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87982024-11-06T00:26:55.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87992024-11-06T00:26:55.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 44.079228ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88002024-11-06T00:26:55.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
88012024-11-06T00:26:55.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88022024-11-06T00:26:55.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88032024-11-06T00:26:55.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88042024-11-06T00:26:55.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88052024-11-06T00:26:55.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
88062024-11-06T00:26:55.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88072024-11-06T00:26:55.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88082024-11-06T00:26:55.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88092024-11-06T00:26:55.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88102024-11-06T00:26:55.851ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 49.20082ms iteration = 16 status = 0
88112024-11-06T00:26:55.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
88122024-11-06T00:26:55.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88132024-11-06T00:26:55.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88142024-11-06T00:26:55.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88152024-11-06T00:26:55.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88162024-11-06T00:26:55.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88172024-11-06T00:26:55.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88182024-11-06T00:26:55.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
88192024-11-06T00:26:55.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 59.285731ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
88202024-11-06T00:26:55.871ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88212024-11-06T00:26:55.871ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
88222024-11-06T00:26:55.871ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88232024-11-06T00:26:55.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88242024-11-06T00:26:55.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.989446ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88252024-11-06T00:26:55.879ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
88262024-11-06T00:26:55.879ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.165202ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
88272024-11-06T00:26:55.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88282024-11-06T00:26:55.885ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88292024-11-06T00:26:55.885ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88302024-11-06T00:26:55.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88312024-11-06T00:26:55.885ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
88322024-11-06T00:26:55.885ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88332024-11-06T00:26:55.886ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfe16fc6-f410-4986-adf4-c86cef8cee1e", "content-length": "26", "date": "Wed, 06 Nov 2024 00:26:55 GMT"} })
88342024-11-06T00:26:55.886ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88352024-11-06T00:26:55.888ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88362024-11-06T00:26:55.899ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
88372024-11-06T00:26:55.899ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88382024-11-06T00:26:55.900ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "05dc1933-958e-4132-ba68-eb228b60f207", "content-length": "26", "date": "Wed, 06 Nov 2024 00:26:55 GMT"} })
88392024-11-06T00:26:55.900ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88402024-11-06T00:26:55.902ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
88412024-11-06T00:26:55.903ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88422024-11-06T00:26:55.903ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
88432024-11-06T00:26:55.903ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 101.748641ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
88442024-11-06T00:26:55.912ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
88452024-11-06T00:26:55.913ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88462024-11-06T00:26:55.913ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "833adb47-9757-44b4-b243-50f5c50babfb", "content-length": "26", "date": "Wed, 06 Nov 2024 00:26:55 GMT"} })
88472024-11-06T00:26:55.913ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88482024-11-06T00:26:55.914ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88492024-11-06T00:26:55.925ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88502024-11-06T00:26:55.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88512024-11-06T00:26:55.932ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 130.636308ms iteration = 18 status = {"physical_disks_added":0}
88522024-11-06T00:26:55.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88532024-11-06T00:26:55.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88542024-11-06T00:26:55.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88552024-11-06T00:26:55.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
88562024-11-06T00:26:55.970ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88572024-11-06T00:26:55.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88582024-11-06T00:26:55.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88592024-11-06T00:26:55.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
88602024-11-06T00:26:55.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88612024-11-06T00:26:55.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88622024-11-06T00:26:56.022ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
88632024-11-06T00:26:56.022ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88642024-11-06T00:26:56.041ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 238.899432ms iteration = 16 status = {}
88652024-11-06T00:26:56.055ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5777090a-3e4b-408e-a994-e1893130b469", "content-length": "372", "date": "Wed, 06 Nov 2024 00:26:55 GMT"} })
88662024-11-06T00:26:56.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88672024-11-06T00:26:56.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88682024-11-06T00:26:56.095ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
88692024-11-06T00:26:56.095ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "58cc9fd8-c893-4ae1-939f-d25378584cd7", "content-length": "1", "date": "Wed, 06 Nov 2024 00:26:55 GMT"} })
88702024-11-06T00:26:56.096ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88712024-11-06T00:26:56.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88722024-11-06T00:26:56.099ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 297.315017ms iteration = 16 status = null
88732024-11-06T00:26:56.101ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
88742024-11-06T00:26:56.101ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
88752024-11-06T00:26:56.101ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "86ba43fb-2785-4e28-bfeb-8df0bebabf59", "date": "Wed, 06 Nov 2024 00:26:56 GMT"} })
88762024-11-06T00:26:56.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88772024-11-06T00:26:56.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88782024-11-06T00:26:56.104ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88792024-11-06T00:26:56.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88802024-11-06T00:26:56.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88812024-11-06T00:26:56.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88822024-11-06T00:26:56.122ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
88832024-11-06T00:26:56.122ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fc63bab-fe79-45ab-bddf-91c6315a031a", "content-length": "691", "date": "Wed, 06 Nov 2024 00:26:56 GMT"} })
88842024-11-06T00:26:56.122ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
88852024-11-06T00:26:56.122ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
88862024-11-06T00:26:56.122ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
88872024-11-06T00:26:56.123ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 321.147165ms iteration = 16 status = {}
88882024-11-06T00:26:56.125ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
88892024-11-06T00:26:56.125ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88902024-11-06T00:26:56.125ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5b3bc5c8-6756-4c05-bbc7-89a94dacd0f6", "date": "Wed, 06 Nov 2024 00:26:56 GMT"} })
88912024-11-06T00:26:56.127ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 325.297168ms iteration = 17 status = {}
88922024-11-06T00:26:56.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88932024-11-06T00:26:56.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88942024-11-06T00:26:56.176ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
88952024-11-06T00:26:56.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88962024-11-06T00:26:56.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88972024-11-06T00:26:56.187ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
88982024-11-06T00:26:56.188ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8692bbe-3a09-4caa-9591-bd924402f1a8", "content-length": "121", "date": "Wed, 06 Nov 2024 00:26:55 GMT"} })
88992024-11-06T00:26:56.188ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
89002024-11-06T00:26:56.188ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
89012024-11-06T00:26:56.188ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
89022024-11-06T00:26:56.188ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
89032024-11-06T00:26:56.188ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89042024-11-06T00:26:56.188ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89052024-11-06T00:26:56.188ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89062024-11-06T00:26:56.188ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89072024-11-06T00:26:56.188ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89082024-11-06T00:26:56.188ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89092024-11-06T00:26:56.188ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
89102024-11-06T00:26:56.188ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89112024-11-06T00:26:56.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89122024-11-06T00:26:56.191ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
89132024-11-06T00:26:56.191ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "829ef0d8-e1e7-4174-81ae-02dac5103c6d", "content-length": "2", "date": "Wed, 06 Nov 2024 00:26:55 GMT"} })
89142024-11-06T00:26:56.191ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
89152024-11-06T00:26:56.191ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d59d1dd-c1e6-432d-84cf-5e5f5ec5a957", "content-length": "52", "date": "Wed, 06 Nov 2024 00:26:55 GMT"} })
89162024-11-06T00:26:56.191ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
89172024-11-06T00:26:56.191ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
89182024-11-06T00:26:56.295ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b0c230cc-bddf-4c44-a21b-3442d8e2abf7", "date": "Wed, 06 Nov 2024 00:26:56 GMT"} })
89192024-11-06T00:26:56.295ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
89202024-11-06T00:26:56.295ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
89212024-11-06T00:26:56.295ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "596ed3a8-681f-466a-a94c-c7f7e944f8ba", "content-length": "669", "date": "Wed, 06 Nov 2024 00:26:56 GMT"} })
89222024-11-06T00:26:56.295ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89232024-11-06T00:26:56.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89242024-11-06T00:26:56.298ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89252024-11-06T00:26:56.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89262024-11-06T00:26:56.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89272024-11-06T00:26:56.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89282024-11-06T00:26:56.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89292024-11-06T00:26:56.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89302024-11-06T00:26:56.311ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 509.381643ms iteration = 16 status = {}
89312024-11-06T00:27:01.471ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1165 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 35825a48-9c30-4252-8e9b-bb4f39f2fda3 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
89322024-11-06T00:27:04.850ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
89332024-11-06T00:27:04.851ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
89342024-11-06T00:27:04.881ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
89352024-11-06T00:27:04.881ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:62544
89362024-11-06T00:27:04.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62544 req_id = 7fd73738-120a-4bec-99c4-d2f7a85bc401 roles = RoleSet { roles: {} } uri = /metrics/producers
89372024-11-06T00:27:04.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62544 req_id = 7fd73738-120a-4bec-99c4-d2f7a85bc401 resource = Database result = Ok(()) uri = /metrics/producers
89382024-11-06T00:27:04.932ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = e2378399-e8ed-453c-847a-0a419dfd0966
89392024-11-06T00:27:04.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51177 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62544 req_id = 7fd73738-120a-4bec-99c4-d2f7a85bc401 response_code = 201 uri = /metrics/producers
89402024-11-06T00:27:04.932ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "7fd73738-120a-4bec-99c4-d2f7a85bc401", "content-length": "41", "date": "Wed, 06 Nov 2024 00:27:04 GMT"} })
89412024-11-06T00:27:04.933ZDEBGnexus (producer-registration-task): registered with nexus successfully
89422024-11-06T00:27:04.933ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
89432024-11-06T00:27:05.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
89442024-11-06T00:27:05.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89452024-11-06T00:27:05.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
89462024-11-06T00:27:05.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89472024-11-06T00:27:05.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89482024-11-06T00:27:05.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89492024-11-06T00:27:05.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89502024-11-06T00:27:05.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89512024-11-06T00:27:05.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89522024-11-06T00:27:05.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89532024-11-06T00:27:05.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89542024-11-06T00:27:05.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89552024-11-06T00:27:05.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89562024-11-06T00:27:05.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89572024-11-06T00:27:05.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89582024-11-06T00:27:05.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
89592024-11-06T00:27:05.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89602024-11-06T00:27:05.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89612024-11-06T00:27:05.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
89622024-11-06T00:27:05.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.133028ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
89632024-11-06T00:27:05.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.081343ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89642024-11-06T00:27:06.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 4f09176c-b6ea-41fb-b3fd-d7281831a17b roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
89652024-11-06T00:27:06.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 4f09176c-b6ea-41fb-b3fd-d7281831a17b resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
89662024-11-06T00:27:06.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 4f09176c-b6ea-41fb-b3fd-d7281831a17b response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
89672024-11-06T00:27:06.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = e8874930-58f0-4e82-9f87-2bb77e5cd696 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
89682024-11-06T00:27:06.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = e8874930-58f0-4e82-9f87-2bb77e5cd696 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
89692024-11-06T00:27:06.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = e8874930-58f0-4e82-9f87-2bb77e5cd696 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
89702024-11-06T00:27:15.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
89712024-11-06T00:27:15.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89722024-11-06T00:27:15.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
89732024-11-06T00:27:15.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89742024-11-06T00:27:15.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89752024-11-06T00:27:15.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89762024-11-06T00:27:15.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89772024-11-06T00:27:15.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89782024-11-06T00:27:15.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89792024-11-06T00:27:15.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.838554ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89802024-11-06T00:27:15.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89812024-11-06T00:27:15.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89822024-11-06T00:27:15.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89832024-11-06T00:27:15.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89842024-11-06T00:27:15.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89852024-11-06T00:27:15.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89862024-11-06T00:27:15.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
89872024-11-06T00:27:15.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89882024-11-06T00:27:15.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89892024-11-06T00:27:15.820ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
89902024-11-06T00:27:15.820ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.971123ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
89912024-11-06T00:27:16.471ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1402 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 7629e955-9f2f-4780-9117-f42731283aac response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
89922024-11-06T00:27:18.733ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:40403
89932024-11-06T00:27:18.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40403 req_id = ad469bb7-21bf-42c6-814f-989cabc0867b roles = RoleSet { roles: {} } uri = /metrics/producers
89942024-11-06T00:27:18.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40403 req_id = ad469bb7-21bf-42c6-814f-989cabc0867b resource = Database result = Ok(()) uri = /metrics/producers
89952024-11-06T00:27:18.771ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = 57aed6c0-b7d9-4021-84f4-804ca56d1b7a
89962024-11-06T00:27:18.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38374 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40403 req_id = ad469bb7-21bf-42c6-814f-989cabc0867b response_code = 201 uri = /metrics/producers
89972024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
89982024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 19.581\u{b5}s iteration = 17 status = {"errors":[],"records_set_to_done":[]}
89992024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
90002024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
90012024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
90022024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90032024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
90042024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90052024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90062024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
90072024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
90082024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90092024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
90102024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.301\u{b5}s iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
90112024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
90122024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
90132024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
90142024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
90152024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
90162024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
90172024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
90182024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
90192024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
90202024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
90212024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
90222024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.68\u{b5}s iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
90232024-11-06T00:27:25.801ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
90242024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90252024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
90262024-11-06T00:27:25.801ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-06 00:17:25.801531525 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
90272024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
90282024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
90292024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
90302024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90312024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
90322024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.32\u{b5}s iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
90332024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
90342024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
90352024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
90362024-11-06T00:27:25.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846
90372024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.191\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846"}
90382024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
90392024-11-06T00:27:25.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
90402024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
90412024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90422024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
90432024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
90442024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
90452024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90462024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
90472024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
90482024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90492024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
90502024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90512024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
90522024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90532024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
90542024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
90552024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90562024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
90572024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
90582024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90592024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90602024-11-06T00:27:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90612024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
90622024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90632024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90642024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90652024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
90662024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90672024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
90682024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90692024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
90702024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
90712024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90722024-11-06T00:27:25.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51df9631-cef5-49ae-8cfd-f0c05bdac388.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7102227a-61f8-4dda-a9a0-f6678fae71c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1509, tv_nsec: 146600227 } })
90732024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90742024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90752024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90762024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
90772024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90782024-11-06T00:27:25.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("309c9aef-da72-4f08-9f70-c20d80316472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1509, tv_nsec: 146650268 } })
90792024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90802024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90812024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
90822024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.372091ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
90832024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
90842024-11-06T00:27:25.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.464353ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
90852024-11-06T00:27:25.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90862024-11-06T00:27:25.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90872024-11-06T00:27:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.665899ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
90882024-11-06T00:27:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.413861ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
90892024-11-06T00:27:25.806ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90902024-11-06T00:27:25.806ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
90912024-11-06T00:27:25.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90922024-11-06T00:27:25.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90932024-11-06T00:27:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
90942024-11-06T00:27:25.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90952024-11-06T00:27:25.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90962024-11-06T00:27:25.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
90972024-11-06T00:27:25.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90982024-11-06T00:27:25.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90992024-11-06T00:27:25.814ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91002024-11-06T00:27:25.814ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1509, tv_nsec: 158778648 } })
91012024-11-06T00:27:25.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
91022024-11-06T00:27:25.814ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91032024-11-06T00:27:25.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91042024-11-06T00:27:25.815ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-06 00:17:25.801531525 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
91052024-11-06T00:27:25.815ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.953055ms iteration = 9 status = {"expiration":"2024-11-06T00:17:25.801531525Z","pruned":[]}
91062024-11-06T00:27:25.816ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91072024-11-06T00:27:25.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
91082024-11-06T00:27:25.816ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91092024-11-06T00:27:25.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91102024-11-06T00:27:25.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91112024-11-06T00:27:25.817ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91122024-11-06T00:27:25.817ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91132024-11-06T00:27:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91142024-11-06T00:27:25.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
91152024-11-06T00:27:25.819ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
91162024-11-06T00:27:25.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
91172024-11-06T00:27:25.819ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91182024-11-06T00:27:25.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91192024-11-06T00:27:25.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91202024-11-06T00:27:25.820ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
91212024-11-06T00:27:25.820ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91222024-11-06T00:27:25.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91232024-11-06T00:27:25.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91242024-11-06T00:27:25.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91252024-11-06T00:27:25.821ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1509, tv_nsec: 165999433 } })
91262024-11-06T00:27:25.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91272024-11-06T00:27:25.821ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
91282024-11-06T00:27:25.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91292024-11-06T00:27:25.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91302024-11-06T00:27:25.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91312024-11-06T00:27:25.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91322024-11-06T00:27:25.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91332024-11-06T00:27:25.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91342024-11-06T00:27:25.829ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91352024-11-06T00:27:25.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91362024-11-06T00:27:25.830ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91372024-11-06T00:27:25.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91382024-11-06T00:27:25.830ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91392024-11-06T00:27:25.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91402024-11-06T00:27:25.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91412024-11-06T00:27:25.831ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1509, tv_nsec: 175570707 } })
91422024-11-06T00:27:25.831ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
91432024-11-06T00:27:25.836ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91442024-11-06T00:27:25.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91452024-11-06T00:27:25.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91462024-11-06T00:27:25.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
91472024-11-06T00:27:25.839ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91482024-11-06T00:27:25.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91492024-11-06T00:27:25.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91502024-11-06T00:27:25.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91512024-11-06T00:27:25.845ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91522024-11-06T00:27:25.847ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91532024-11-06T00:27:25.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91542024-11-06T00:27:25.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91552024-11-06T00:27:25.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91562024-11-06T00:27:25.851ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91572024-11-06T00:27:25.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91582024-11-06T00:27:25.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91592024-11-06T00:27:25.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91602024-11-06T00:27:25.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
91612024-11-06T00:27:25.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.989521ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
91622024-11-06T00:27:25.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91632024-11-06T00:27:25.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91642024-11-06T00:27:25.864ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
91652024-11-06T00:27:25.864ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
91662024-11-06T00:27:25.864ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 63.337871ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
91672024-11-06T00:27:25.866ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
91682024-11-06T00:27:25.866ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
91692024-11-06T00:27:25.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91702024-11-06T00:27:25.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91712024-11-06T00:27:25.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91722024-11-06T00:27:25.866ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
91732024-11-06T00:27:25.866ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.319509ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
91742024-11-06T00:27:25.866ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
91752024-11-06T00:27:25.866ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
91762024-11-06T00:27:25.866ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 65.164104ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
91772024-11-06T00:27:25.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91782024-11-06T00:27:25.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91792024-11-06T00:27:25.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
91802024-11-06T00:27:25.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91812024-11-06T00:27:25.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91822024-11-06T00:27:25.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91832024-11-06T00:27:25.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91842024-11-06T00:27:25.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91852024-11-06T00:27:25.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91862024-11-06T00:27:25.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
91872024-11-06T00:27:25.872ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91882024-11-06T00:27:25.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91892024-11-06T00:27:25.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
91902024-11-06T00:27:25.875ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 73.719358ms iteration = 17 status = 0
91912024-11-06T00:27:25.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.195022ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91922024-11-06T00:27:25.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91932024-11-06T00:27:25.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91942024-11-06T00:27:25.885ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91952024-11-06T00:27:25.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91962024-11-06T00:27:25.887ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91972024-11-06T00:27:25.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91982024-11-06T00:27:25.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
91992024-11-06T00:27:25.889ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92002024-11-06T00:27:25.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92012024-11-06T00:27:25.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
92022024-11-06T00:27:25.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92032024-11-06T00:27:25.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92042024-11-06T00:27:25.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
92052024-11-06T00:27:25.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
92062024-11-06T00:27:25.905ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
92072024-11-06T00:27:25.905ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
92082024-11-06T00:27:25.905ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
92092024-11-06T00:27:25.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92102024-11-06T00:27:25.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92112024-11-06T00:27:25.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92122024-11-06T00:27:25.906ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
92132024-11-06T00:27:25.906ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 105.06316ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
92142024-11-06T00:27:25.906ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92152024-11-06T00:27:25.907ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92162024-11-06T00:27:25.907ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
92172024-11-06T00:27:25.907ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.682638ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
92182024-11-06T00:27:25.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92192024-11-06T00:27:25.909ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92202024-11-06T00:27:25.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92212024-11-06T00:27:25.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92222024-11-06T00:27:25.909ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92232024-11-06T00:27:25.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92242024-11-06T00:27:25.917ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
92252024-11-06T00:27:25.917ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
92262024-11-06T00:27:25.917ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
92272024-11-06T00:27:25.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92282024-11-06T00:27:25.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92292024-11-06T00:27:25.932ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-06T00:19:22.736570Z, time_modified: 2024-11-06T00:19:22.736570Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }) }
92302024-11-06T00:27:25.932ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 130.369041ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]}},"default_endpoint":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
92312024-11-06T00:27:25.932ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
92322024-11-06T00:27:25.947ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
92332024-11-06T00:27:25.947ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
92342024-11-06T00:27:25.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92352024-11-06T00:27:25.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92362024-11-06T00:27:25.957ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
92372024-11-06T00:27:25.957ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92382024-11-06T00:27:25.957ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88a1f66e-3a82-4553-ab79-2a8593643591", "content-length": "26", "date": "Wed, 06 Nov 2024 00:27:25 GMT"} })
92392024-11-06T00:27:25.957ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92402024-11-06T00:27:25.957ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 156.106105ms iteration = 19 status = {"physical_disks_added":0}
92412024-11-06T00:27:25.958ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92422024-11-06T00:27:25.965ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
92432024-11-06T00:27:25.965ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 164.114872ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
92442024-11-06T00:27:25.995ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
92452024-11-06T00:27:25.995ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
92462024-11-06T00:27:25.995ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92472024-11-06T00:27:25.995ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92482024-11-06T00:27:25.995ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cd357bf-b034-4fcd-869f-f46e0adf41ba", "content-length": "26", "date": "Wed, 06 Nov 2024 00:27:25 GMT"} })
92492024-11-06T00:27:25.995ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92502024-11-06T00:27:25.995ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c68335ff-260a-45da-aec1-5b503c0ac16a", "content-length": "26", "date": "Wed, 06 Nov 2024 00:27:25 GMT"} })
92512024-11-06T00:27:25.995ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92522024-11-06T00:27:25.996ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
92532024-11-06T00:27:25.997ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92542024-11-06T00:27:26.008ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
92552024-11-06T00:27:26.113ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
92562024-11-06T00:27:26.113ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "969b9e33-613d-4dc8-ba4a-f2121089f5ec", "content-length": "691", "date": "Wed, 06 Nov 2024 00:27:26 GMT"} })
92572024-11-06T00:27:26.113ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
92582024-11-06T00:27:26.113ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
92592024-11-06T00:27:26.113ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
92602024-11-06T00:27:26.115ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 313.308972ms iteration = 17 status = {}
92612024-11-06T00:27:26.129ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
92622024-11-06T00:27:26.129ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2090b49f-2c87-461f-81aa-ee471399c8c3", "content-length": "1", "date": "Wed, 06 Nov 2024 00:27:25 GMT"} })
92632024-11-06T00:27:26.130ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92642024-11-06T00:27:26.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92652024-11-06T00:27:26.139ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
92662024-11-06T00:27:26.191ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 389.708301ms iteration = 17 status = {}
92672024-11-06T00:27:26.228ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
92682024-11-06T00:27:26.228ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92692024-11-06T00:27:26.229ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5672f394-eb13-4925-8209-ed0b11535067", "content-length": "372", "date": "Wed, 06 Nov 2024 00:27:26 GMT"} })
92702024-11-06T00:27:26.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92712024-11-06T00:27:26.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92722024-11-06T00:27:26.230ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92732024-11-06T00:27:26.231ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92742024-11-06T00:27:26.232ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 430.674897ms iteration = 17 status = null
92752024-11-06T00:27:26.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
92762024-11-06T00:27:26.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92772024-11-06T00:27:26.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92782024-11-06T00:27:26.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92792024-11-06T00:27:26.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92802024-11-06T00:27:26.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92812024-11-06T00:27:26.237ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
92822024-11-06T00:27:26.237ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
92832024-11-06T00:27:26.237ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-06 00:19:32.804378 UTC dns_group = internal generation = 1
92842024-11-06T00:27:26.237ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 435.717646ms iteration = 10 status = {"generation":1}
92852024-11-06T00:27:26.251ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
92862024-11-06T00:27:26.252ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b8aee811-b458-46a7-a17e-8536de468f21", "date": "Wed, 06 Nov 2024 00:27:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
92872024-11-06T00:27:26.252ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
92882024-11-06T00:27:26.252ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
92892024-11-06T00:27:26.252ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3b006f68-3e65-4595-8584-ba2955f46f60", "date": "Wed, 06 Nov 2024 00:27:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92902024-11-06T00:27:26.252ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92912024-11-06T00:27:26.254ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6e561f62-c153-4a8a-a1b6-0b5aa291fcfe", "date": "Wed, 06 Nov 2024 00:27:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
92922024-11-06T00:27:26.254ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
92932024-11-06T00:27:26.254ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f210ba2f-659b-4aeb-96ff-8125cacdd8d5", "date": "Wed, 06 Nov 2024 00:27:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92942024-11-06T00:27:26.254ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92952024-11-06T00:27:26.256ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "691766dc-16e2-41ad-9ef8-2864003c0a9a", "date": "Wed, 06 Nov 2024 00:27:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
92962024-11-06T00:27:26.256ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
92972024-11-06T00:27:26.257ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92982024-11-06T00:27:26.257ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 455.942426ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
92992024-11-06T00:27:26.258ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
93002024-11-06T00:27:26.258ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 456.539904ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
93012024-11-06T00:27:26.268ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
93022024-11-06T00:27:26.268ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
93032024-11-06T00:27:26.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93042024-11-06T00:27:26.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93052024-11-06T00:27:26.272ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
93062024-11-06T00:27:26.272ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
93072024-11-06T00:27:26.272ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2aba2e12-26cc-4474-9499-cae780855628", "date": "Wed, 06 Nov 2024 00:27:26 GMT"} })
93082024-11-06T00:27:26.272ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93092024-11-06T00:27:26.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93102024-11-06T00:27:26.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93112024-11-06T00:27:26.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93122024-11-06T00:27:26.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93132024-11-06T00:27:26.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93142024-11-06T00:27:26.281ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
93152024-11-06T00:27:26.281ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93162024-11-06T00:27:26.281ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ff43008c-b391-4832-9521-d7ca814a4694", "date": "Wed, 06 Nov 2024 00:27:26 GMT"} })
93172024-11-06T00:27:26.283ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 481.492765ms iteration = 18 status = {}
93182024-11-06T00:27:26.290ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93192024-11-06T00:27:26.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93202024-11-06T00:27:26.293ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
93212024-11-06T00:27:26.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93222024-11-06T00:27:26.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93232024-11-06T00:27:26.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93242024-11-06T00:27:26.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
93252024-11-06T00:27:26.298ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93262024-11-06T00:27:26.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93272024-11-06T00:27:26.300ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
93282024-11-06T00:27:26.300ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
93292024-11-06T00:27:26.300ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-06 00:19:33.391850 UTC dns_group = external generation = 2
93302024-11-06T00:27:26.300ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 498.595563ms iteration = 10 status = {"generation":2}
93312024-11-06T00:27:26.301ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
93322024-11-06T00:27:26.301ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d1201be-608b-40e4-845d-7cbd96aef321", "content-length": "121", "date": "Wed, 06 Nov 2024 00:27:25 GMT"} })
93332024-11-06T00:27:26.301ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
93342024-11-06T00:27:26.301ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
93352024-11-06T00:27:26.301ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
93362024-11-06T00:27:26.301ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
93372024-11-06T00:27:26.301ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93382024-11-06T00:27:26.301ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93392024-11-06T00:27:26.301ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93402024-11-06T00:27:26.301ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93412024-11-06T00:27:26.302ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93422024-11-06T00:27:26.302ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93432024-11-06T00:27:26.302ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
93442024-11-06T00:27:26.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93452024-11-06T00:27:26.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93462024-11-06T00:27:26.304ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
93472024-11-06T00:27:26.304ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d88d812d-74f0-40c8-9d69-59d85d031181", "content-length": "2", "date": "Wed, 06 Nov 2024 00:27:25 GMT"} })
93482024-11-06T00:27:26.304ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
93492024-11-06T00:27:26.304ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "04a0219f-5eaf-4634-9f43-b133d106c29e", "content-length": "52", "date": "Wed, 06 Nov 2024 00:27:25 GMT"} })
93502024-11-06T00:27:26.304ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
93512024-11-06T00:27:26.304ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
93522024-11-06T00:27:26.401ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5c53193e-2986-4fbe-b5eb-a3ad1e3279c6", "date": "Wed, 06 Nov 2024 00:27:26 GMT"} })
93532024-11-06T00:27:26.401ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
93542024-11-06T00:27:26.401ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
93552024-11-06T00:27:26.401ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "48462091-253c-4810-ba5e-1164255dc543", "content-length": "669", "date": "Wed, 06 Nov 2024 00:27:26 GMT"} })
93562024-11-06T00:27:26.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93572024-11-06T00:27:26.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93582024-11-06T00:27:26.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93592024-11-06T00:27:26.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93602024-11-06T00:27:26.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93612024-11-06T00:27:26.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93622024-11-06T00:27:26.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93632024-11-06T00:27:26.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93642024-11-06T00:27:26.417ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 615.877214ms iteration = 17 status = {}
93652024-11-06T00:27:31.470ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1113 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = bc5d6988-0b60-46ae-ba1e-423eb938456b response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
93662024-11-06T00:27:35.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
93672024-11-06T00:27:35.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93682024-11-06T00:27:35.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
93692024-11-06T00:27:35.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93702024-11-06T00:27:35.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93712024-11-06T00:27:35.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93722024-11-06T00:27:35.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93732024-11-06T00:27:35.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93742024-11-06T00:27:35.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93752024-11-06T00:27:35.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93762024-11-06T00:27:35.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93772024-11-06T00:27:35.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.315919ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93782024-11-06T00:27:35.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93792024-11-06T00:27:35.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93802024-11-06T00:27:35.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93812024-11-06T00:27:35.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93822024-11-06T00:27:35.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
93832024-11-06T00:27:35.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93842024-11-06T00:27:35.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93852024-11-06T00:27:35.853ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
93862024-11-06T00:27:35.853ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.694965ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
93872024-11-06T00:27:36.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 7dd2cf2b-1352-4a11-b070-d66cbacc9e99 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
93882024-11-06T00:27:36.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 7dd2cf2b-1352-4a11-b070-d66cbacc9e99 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
93892024-11-06T00:27:36.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 7dd2cf2b-1352-4a11-b070-d66cbacc9e99 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
93902024-11-06T00:27:36.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = f9c84cc2-21ad-460e-ac45-4639c1db7929 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
93912024-11-06T00:27:36.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = f9c84cc2-21ad-460e-ac45-4639c1db7929 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
93922024-11-06T00:27:36.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = f9c84cc2-21ad-460e-ac45-4639c1db7929 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
93932024-11-06T00:27:45.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
93942024-11-06T00:27:45.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
93952024-11-06T00:27:45.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93962024-11-06T00:27:45.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93972024-11-06T00:27:45.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93982024-11-06T00:27:45.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93992024-11-06T00:27:45.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94002024-11-06T00:27:45.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94012024-11-06T00:27:45.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94022024-11-06T00:27:45.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94032024-11-06T00:27:45.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94042024-11-06T00:27:45.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94052024-11-06T00:27:45.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94062024-11-06T00:27:45.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
94072024-11-06T00:27:45.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94082024-11-06T00:27:45.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94092024-11-06T00:27:45.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
94102024-11-06T00:27:45.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.345093ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
94112024-11-06T00:27:45.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94122024-11-06T00:27:45.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94132024-11-06T00:27:45.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.708022ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94142024-11-06T00:27:46.470ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1064 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = b7cebeed-8c40-4237-b595-6e7f459dd1cc response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
94152024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
94162024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94172024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
94182024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
94192024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94202024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
94212024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94222024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.541\u{b5}s iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
94232024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
94242024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
94252024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.84\u{b5}s iteration = 18 status = {"errors":[],"records_set_to_done":[]}
94262024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
94272024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
94282024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.81\u{b5}s iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
94292024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
94302024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
94312024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.48\u{b5}s iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
94322024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
94332024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
94342024-11-06T00:27:55.800ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
94352024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
94362024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
94372024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94382024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
94392024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94402024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94412024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
94422024-11-06T00:27:55.800ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
94432024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
94442024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94452024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
94462024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
94472024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94482024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
94492024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94502024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94512024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
94522024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
94532024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94542024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94552024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94562024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94572024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94582024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
94592024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94602024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94612024-11-06T00:27:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94622024-11-06T00:27:55.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94632024-11-06T00:27:55.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94642024-11-06T00:27:55.804ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.7052ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
94652024-11-06T00:27:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94662024-11-06T00:27:55.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94672024-11-06T00:27:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94682024-11-06T00:27:55.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94692024-11-06T00:27:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94702024-11-06T00:27:55.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
94712024-11-06T00:27:55.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94722024-11-06T00:27:55.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94732024-11-06T00:27:55.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94742024-11-06T00:27:55.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94752024-11-06T00:27:55.811ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1539, tv_nsec: 156508261 } })
94762024-11-06T00:27:55.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
94772024-11-06T00:27:55.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94782024-11-06T00:27:55.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94792024-11-06T00:27:55.812ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94802024-11-06T00:27:55.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94812024-11-06T00:27:55.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94822024-11-06T00:27:55.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94832024-11-06T00:27:55.815ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1539, tv_nsec: 159873311 } })
94842024-11-06T00:27:55.815ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
94852024-11-06T00:27:55.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94862024-11-06T00:27:55.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94872024-11-06T00:27:55.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94882024-11-06T00:27:55.816ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1539, tv_nsec: 161406386 } })
94892024-11-06T00:27:55.816ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
94902024-11-06T00:27:55.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94912024-11-06T00:27:55.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94922024-11-06T00:27:55.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94932024-11-06T00:27:55.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94942024-11-06T00:27:55.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94952024-11-06T00:27:55.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94962024-11-06T00:27:55.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
94972024-11-06T00:27:55.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94982024-11-06T00:27:55.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94992024-11-06T00:27:55.832ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
95002024-11-06T00:27:55.832ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.179055ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
95012024-11-06T00:27:55.840ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
95022024-11-06T00:27:55.840ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
95032024-11-06T00:27:55.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95042024-11-06T00:27:55.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95052024-11-06T00:27:55.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95062024-11-06T00:27:55.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95072024-11-06T00:27:55.843ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
95082024-11-06T00:27:55.843ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
95092024-11-06T00:27:55.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95102024-11-06T00:27:55.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95112024-11-06T00:27:55.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
95122024-11-06T00:27:55.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
95132024-11-06T00:27:55.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
95142024-11-06T00:27:55.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95152024-11-06T00:27:55.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
95162024-11-06T00:27:55.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
95172024-11-06T00:27:55.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95182024-11-06T00:27:55.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
95192024-11-06T00:27:55.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 45.045907ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95202024-11-06T00:27:55.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95212024-11-06T00:27:55.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95222024-11-06T00:27:55.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95232024-11-06T00:27:55.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
95242024-11-06T00:27:55.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95252024-11-06T00:27:55.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95262024-11-06T00:27:55.874ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95272024-11-06T00:27:55.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95282024-11-06T00:27:55.876ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
95292024-11-06T00:27:55.876ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
95302024-11-06T00:27:55.876ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 75.44503ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
95312024-11-06T00:27:55.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95322024-11-06T00:27:55.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95332024-11-06T00:27:55.878ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95342024-11-06T00:27:55.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
95352024-11-06T00:27:55.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95362024-11-06T00:27:55.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95372024-11-06T00:27:55.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.114458ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
95382024-11-06T00:27:55.884ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 83.100867ms iteration = 18 status = 0
95392024-11-06T00:27:55.887ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
95402024-11-06T00:27:55.887ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 86.271081ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
95412024-11-06T00:27:55.888ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
95422024-11-06T00:27:55.888ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95432024-11-06T00:27:55.888ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec687d07-f94b-457e-9437-466ba0f446ac", "content-length": "26", "date": "Wed, 06 Nov 2024 00:27:55 GMT"} })
95442024-11-06T00:27:55.888ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95452024-11-06T00:27:55.890ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
95462024-11-06T00:27:55.890ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95472024-11-06T00:27:55.890ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cda1af6-fd5e-4a17-a81b-f5e09dcb414b", "content-length": "26", "date": "Wed, 06 Nov 2024 00:27:55 GMT"} })
95482024-11-06T00:27:55.890ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95492024-11-06T00:27:55.890ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95502024-11-06T00:27:55.891ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
95512024-11-06T00:27:55.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95522024-11-06T00:27:55.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95532024-11-06T00:27:55.926ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
95542024-11-06T00:27:55.926ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95552024-11-06T00:27:55.927ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "997aea57-0372-4a1c-962e-a6b36ff1c513", "content-length": "26", "date": "Wed, 06 Nov 2024 00:27:55 GMT"} })
95562024-11-06T00:27:55.927ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95572024-11-06T00:27:55.929ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95582024-11-06T00:27:55.964ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 163.618167ms iteration = 20 status = {"physical_disks_added":0}
95592024-11-06T00:27:56.001ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 200.790082ms iteration = 18 status = {}
95602024-11-06T00:27:56.006ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
95612024-11-06T00:27:56.006ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95622024-11-06T00:27:56.007ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ce90d48-c349-428c-9254-89ec2eb9eff2", "content-length": "372", "date": "Wed, 06 Nov 2024 00:27:55 GMT"} })
95632024-11-06T00:27:56.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95642024-11-06T00:27:56.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95652024-11-06T00:27:56.023ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
95662024-11-06T00:27:56.024ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0920428-713c-45fa-a24d-3d204d0ed109", "content-length": "1", "date": "Wed, 06 Nov 2024 00:27:55 GMT"} })
95672024-11-06T00:27:56.025ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95682024-11-06T00:27:56.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95692024-11-06T00:27:56.027ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 227.126174ms iteration = 18 status = null
95702024-11-06T00:27:56.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95712024-11-06T00:27:56.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95722024-11-06T00:27:56.046ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
95732024-11-06T00:27:56.046ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
95742024-11-06T00:27:56.046ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "53083c16-5c13-4337-b022-827cb385eff3", "date": "Wed, 06 Nov 2024 00:27:55 GMT"} })
95752024-11-06T00:27:56.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95762024-11-06T00:27:56.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95772024-11-06T00:27:56.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95782024-11-06T00:27:56.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95792024-11-06T00:27:56.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95802024-11-06T00:27:56.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95812024-11-06T00:27:56.054ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95822024-11-06T00:27:56.054ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95832024-11-06T00:27:56.055ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2e0c485e-3bf8-4223-a87d-59e239e48783", "date": "Wed, 06 Nov 2024 00:27:55 GMT"} })
95842024-11-06T00:27:56.056ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 255.631219ms iteration = 19 status = {}
95852024-11-06T00:27:56.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95862024-11-06T00:27:56.071ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95872024-11-06T00:27:56.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95882024-11-06T00:27:56.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95892024-11-06T00:27:56.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95902024-11-06T00:27:56.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95912024-11-06T00:27:56.077ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
95922024-11-06T00:27:56.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95932024-11-06T00:27:56.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95942024-11-06T00:27:56.085ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
95952024-11-06T00:27:56.085ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a1a7d7a-6f56-4110-92b6-53337c545706", "content-length": "121", "date": "Wed, 06 Nov 2024 00:27:55 GMT"} })
95962024-11-06T00:27:56.085ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
95972024-11-06T00:27:56.085ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
95982024-11-06T00:27:56.086ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
95992024-11-06T00:27:56.086ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
96002024-11-06T00:27:56.086ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96012024-11-06T00:27:56.086ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96022024-11-06T00:27:56.086ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96032024-11-06T00:27:56.086ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
96042024-11-06T00:27:56.086ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96052024-11-06T00:27:56.086ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
96062024-11-06T00:27:56.086ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
96072024-11-06T00:27:56.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96082024-11-06T00:27:56.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96092024-11-06T00:27:56.088ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
96102024-11-06T00:27:56.088ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4565778a-1cab-4a9f-b9ac-c3dc5a990e92", "content-length": "2", "date": "Wed, 06 Nov 2024 00:27:55 GMT"} })
96112024-11-06T00:27:56.088ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
96122024-11-06T00:27:56.088ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0ef6d78-3f6e-484b-b788-220d0dbb9b8e", "content-length": "52", "date": "Wed, 06 Nov 2024 00:27:55 GMT"} })
96132024-11-06T00:27:56.088ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
96142024-11-06T00:27:56.088ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
96152024-11-06T00:27:56.099ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96162024-11-06T00:27:56.101ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
96172024-11-06T00:27:56.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96182024-11-06T00:27:56.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96192024-11-06T00:27:56.134ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
96202024-11-06T00:27:56.193ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "726635d8-1d7a-4582-be96-0db4bdbd7b73", "date": "Wed, 06 Nov 2024 00:27:55 GMT"} })
96212024-11-06T00:27:56.193ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
96222024-11-06T00:27:56.193ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
96232024-11-06T00:27:56.193ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbe2abe9-ad55-4127-8c23-b2a5549d3739", "content-length": "669", "date": "Wed, 06 Nov 2024 00:27:56 GMT"} })
96242024-11-06T00:27:56.193ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96252024-11-06T00:27:56.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96262024-11-06T00:27:56.194ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "58d31281-a954-4e9e-a7ba-cd363edfcd67", "content-length": "691", "date": "Wed, 06 Nov 2024 00:27:55 GMT"} })
96272024-11-06T00:27:56.194ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
96282024-11-06T00:27:56.194ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
96292024-11-06T00:27:56.194ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
96302024-11-06T00:27:56.195ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 394.821802ms iteration = 18 status = {}
96312024-11-06T00:27:56.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96322024-11-06T00:27:56.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96332024-11-06T00:27:56.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96342024-11-06T00:27:56.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96352024-11-06T00:27:56.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96362024-11-06T00:27:56.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96372024-11-06T00:27:56.211ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 410.648221ms iteration = 18 status = {}
96382024-11-06T00:28:00.192ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:35141
96392024-11-06T00:28:00.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35141 req_id = 97cf1b09-1199-46e2-853f-4c54f7b2ac00 roles = RoleSet { roles: {} } uri = /metrics/producers
96402024-11-06T00:28:00.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35141 req_id = 97cf1b09-1199-46e2-853f-4c54f7b2ac00 resource = Database result = Ok(()) uri = /metrics/producers
96412024-11-06T00:28:00.229ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = 7c647f25-eb29-494d-840d-11658133af45
96422024-11-06T00:28:00.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37078 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35141 req_id = 97cf1b09-1199-46e2-853f-4c54f7b2ac00 response_code = 201 uri = /metrics/producers
96432024-11-06T00:28:01.470ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1448 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 18e58c03-4053-49ec-a98a-8b0b3150937d response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
96442024-11-06T00:28:05.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
96452024-11-06T00:28:05.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96462024-11-06T00:28:05.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
96472024-11-06T00:28:05.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96482024-11-06T00:28:05.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96492024-11-06T00:28:05.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96502024-11-06T00:28:05.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96512024-11-06T00:28:05.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96522024-11-06T00:28:05.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96532024-11-06T00:28:05.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96542024-11-06T00:28:05.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96552024-11-06T00:28:05.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96562024-11-06T00:28:05.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96572024-11-06T00:28:05.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96582024-11-06T00:28:05.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96592024-11-06T00:28:05.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
96602024-11-06T00:28:05.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96612024-11-06T00:28:05.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96622024-11-06T00:28:05.820ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
96632024-11-06T00:28:05.820ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.449517ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
96642024-11-06T00:28:05.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.608278ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96652024-11-06T00:28:06.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 9b56cfbf-e187-44b5-8582-d59166796802 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
96662024-11-06T00:28:06.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 9b56cfbf-e187-44b5-8582-d59166796802 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
96672024-11-06T00:28:06.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2962 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 9b56cfbf-e187-44b5-8582-d59166796802 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
96682024-11-06T00:28:06.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = dafdf848-32c1-4052-a87e-cbf5ce1db84c roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
96692024-11-06T00:28:06.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = dafdf848-32c1-4052-a87e-cbf5ce1db84c resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
96702024-11-06T00:28:06.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = dafdf848-32c1-4052-a87e-cbf5ce1db84c response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
96712024-11-06T00:28:15.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
96722024-11-06T00:28:15.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
96732024-11-06T00:28:15.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96742024-11-06T00:28:15.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96752024-11-06T00:28:15.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96762024-11-06T00:28:15.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96772024-11-06T00:28:15.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96782024-11-06T00:28:15.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96792024-11-06T00:28:15.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96802024-11-06T00:28:15.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.600137ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96812024-11-06T00:28:15.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96822024-11-06T00:28:15.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96832024-11-06T00:28:15.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96842024-11-06T00:28:15.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96852024-11-06T00:28:15.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96862024-11-06T00:28:15.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96872024-11-06T00:28:15.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
96882024-11-06T00:28:15.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96892024-11-06T00:28:15.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96902024-11-06T00:28:15.881ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
96912024-11-06T00:28:15.881ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.038386ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
96922024-11-06T00:28:16.471ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1518 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 901a740f-ea91-4f05-b8a8-63e4d14475b0 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
96932024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
96942024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96952024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
96962024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
96972024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
96982024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
96992024-11-06T00:28:25.801ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
97002024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97012024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97022024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
97032024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
97042024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
97052024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97062024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
97072024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
97082024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 16.38\u{b5}s iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
97092024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
97102024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
97112024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
97122024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
97132024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
97142024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
97152024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
97162024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.58\u{b5}s iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
97172024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
97182024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
97192024-11-06T00:28:25.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
97202024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.03\u{b5}s iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
97212024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97222024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
97232024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
97242024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
97252024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97262024-11-06T00:28:25.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846
97272024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
97282024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.65\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846"}
97292024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
97302024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97312024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97322024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
97332024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97342024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
97352024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
97362024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97372024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97382024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
97392024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97402024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
97412024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.69\u{b5}s iteration = 19 status = {"errors":[],"records_set_to_done":[]}
97422024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
97432024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
97442024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
97452024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
97462024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
97472024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
97482024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
97492024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
97502024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97512024-11-06T00:28:25.801ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-06 00:18:25.801457573 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
97522024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
97532024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
97542024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97552024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
97562024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97572024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97582024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97592024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
97602024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97612024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97622024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
97632024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
97642024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97652024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97662024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97672024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97682024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97692024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97702024-11-06T00:28:25.801ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51df9631-cef5-49ae-8cfd-f0c05bdac388.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7102227a-61f8-4dda-a9a0-f6678fae71c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1569, tv_nsec: 147033180 } })
97712024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97722024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97732024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97742024-11-06T00:28:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97752024-11-06T00:28:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
97762024-11-06T00:28:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
97772024-11-06T00:28:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97782024-11-06T00:28:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
97792024-11-06T00:28:25.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("309c9aef-da72-4f08-9f70-c20d80316472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1569, tv_nsec: 147152783 } })
97802024-11-06T00:28:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97812024-11-06T00:28:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97822024-11-06T00:28:25.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97832024-11-06T00:28:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97842024-11-06T00:28:25.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97852024-11-06T00:28:25.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
97862024-11-06T00:28:25.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.260928ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
97872024-11-06T00:28:25.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
97882024-11-06T00:28:25.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.270218ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
97892024-11-06T00:28:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97902024-11-06T00:28:25.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97912024-11-06T00:28:25.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97922024-11-06T00:28:25.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97932024-11-06T00:28:25.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97942024-11-06T00:28:25.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97952024-11-06T00:28:25.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97962024-11-06T00:28:25.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.05742ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97972024-11-06T00:28:25.806ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.367479ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
97982024-11-06T00:28:25.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97992024-11-06T00:28:25.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
98002024-11-06T00:28:25.810ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98012024-11-06T00:28:25.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98022024-11-06T00:28:25.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98032024-11-06T00:28:25.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98042024-11-06T00:28:25.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98052024-11-06T00:28:25.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98062024-11-06T00:28:25.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98072024-11-06T00:28:25.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98082024-11-06T00:28:25.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98092024-11-06T00:28:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98102024-11-06T00:28:25.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98112024-11-06T00:28:25.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98122024-11-06T00:28:25.822ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-06 00:18:25.801457573 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
98132024-11-06T00:28:25.822ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.615132ms iteration = 10 status = {"expiration":"2024-11-06T00:18:25.801457573Z","pruned":[]}
98142024-11-06T00:28:25.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1569, tv_nsec: 167249110 } })
98152024-11-06T00:28:25.822ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
98162024-11-06T00:28:25.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1569, tv_nsec: 167952961 } })
98172024-11-06T00:28:25.823ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
98182024-11-06T00:28:25.824ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98192024-11-06T00:28:25.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98202024-11-06T00:28:25.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98212024-11-06T00:28:25.827ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98222024-11-06T00:28:25.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98232024-11-06T00:28:25.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98242024-11-06T00:28:25.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98252024-11-06T00:28:25.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98262024-11-06T00:28:25.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98272024-11-06T00:28:25.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98282024-11-06T00:28:25.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98292024-11-06T00:28:25.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98302024-11-06T00:28:25.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98312024-11-06T00:28:25.841ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98322024-11-06T00:28:25.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98332024-11-06T00:28:25.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98342024-11-06T00:28:25.849ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
98352024-11-06T00:28:25.849ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
98362024-11-06T00:28:25.849ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 48.112939ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
98372024-11-06T00:28:25.853ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98382024-11-06T00:28:25.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
98392024-11-06T00:28:25.857ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
98402024-11-06T00:28:25.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
98412024-11-06T00:28:25.871ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98422024-11-06T00:28:25.872ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98432024-11-06T00:28:25.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98442024-11-06T00:28:25.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98452024-11-06T00:28:25.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98462024-11-06T00:28:25.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98472024-11-06T00:28:25.875ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98482024-11-06T00:28:25.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98492024-11-06T00:28:25.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
98502024-11-06T00:28:25.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98512024-11-06T00:28:25.876ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98522024-11-06T00:28:25.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98532024-11-06T00:28:25.877ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98542024-11-06T00:28:25.877ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
98552024-11-06T00:28:25.877ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98562024-11-06T00:28:25.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98572024-11-06T00:28:25.877ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98582024-11-06T00:28:25.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98592024-11-06T00:28:25.877ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98602024-11-06T00:28:25.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98612024-11-06T00:28:25.878ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98622024-11-06T00:28:25.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98632024-11-06T00:28:25.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
98642024-11-06T00:28:25.879ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
98652024-11-06T00:28:25.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98662024-11-06T00:28:25.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
98672024-11-06T00:28:25.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98682024-11-06T00:28:25.880ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98692024-11-06T00:28:25.880ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98702024-11-06T00:28:25.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98712024-11-06T00:28:25.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98722024-11-06T00:28:25.881ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98732024-11-06T00:28:25.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98742024-11-06T00:28:25.881ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98752024-11-06T00:28:25.883ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98762024-11-06T00:28:25.883ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98772024-11-06T00:28:25.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98782024-11-06T00:28:25.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98792024-11-06T00:28:25.884ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98802024-11-06T00:28:25.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98812024-11-06T00:28:25.885ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 84.18621ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98822024-11-06T00:28:25.887ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1569, tv_nsec: 232994302 } })
98832024-11-06T00:28:25.888ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
98842024-11-06T00:28:25.888ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
98852024-11-06T00:28:25.888ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
98862024-11-06T00:28:25.888ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
98872024-11-06T00:28:25.888ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98882024-11-06T00:28:25.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98892024-11-06T00:28:25.888ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
98902024-11-06T00:28:25.888ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
98912024-11-06T00:28:25.889ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
98922024-11-06T00:28:25.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98932024-11-06T00:28:25.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98942024-11-06T00:28:25.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98952024-11-06T00:28:25.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98962024-11-06T00:28:25.890ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
98972024-11-06T00:28:25.890ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98982024-11-06T00:28:25.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
98992024-11-06T00:28:25.891ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 89.781815ms iteration = 5 status = {"nsuccess":5}
99002024-11-06T00:28:25.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99012024-11-06T00:28:25.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99022024-11-06T00:28:25.891ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99032024-11-06T00:28:25.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99042024-11-06T00:28:25.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
99052024-11-06T00:28:25.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99062024-11-06T00:28:25.893ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99072024-11-06T00:28:25.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
99082024-11-06T00:28:25.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99092024-11-06T00:28:25.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99102024-11-06T00:28:25.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
99112024-11-06T00:28:25.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99122024-11-06T00:28:25.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99132024-11-06T00:28:25.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
99142024-11-06T00:28:25.896ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99152024-11-06T00:28:25.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99162024-11-06T00:28:25.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
99172024-11-06T00:28:25.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99182024-11-06T00:28:25.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99192024-11-06T00:28:25.899ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.822274ms iteration = 19 status = 0
99202024-11-06T00:28:25.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99212024-11-06T00:28:25.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
99222024-11-06T00:28:25.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99232024-11-06T00:28:25.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99242024-11-06T00:28:25.922ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
99252024-11-06T00:28:25.922ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
99262024-11-06T00:28:25.923ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 121.793126ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
99272024-11-06T00:28:25.925ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
99282024-11-06T00:28:25.925ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 124.009802ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
99292024-11-06T00:28:25.926ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99302024-11-06T00:28:25.926ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
99312024-11-06T00:28:25.926ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99322024-11-06T00:28:25.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99332024-11-06T00:28:25.930ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 128.6706ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
99342024-11-06T00:28:25.931ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99352024-11-06T00:28:25.931ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
99362024-11-06T00:28:25.931ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 130.387241ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
99372024-11-06T00:28:25.931ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
99382024-11-06T00:28:25.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
99392024-11-06T00:28:25.934ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99402024-11-06T00:28:25.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
99412024-11-06T00:28:25.941ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
99422024-11-06T00:28:25.941ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
99432024-11-06T00:28:25.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99442024-11-06T00:28:25.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99452024-11-06T00:28:25.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99462024-11-06T00:28:25.951ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
99472024-11-06T00:28:25.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99482024-11-06T00:28:25.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99492024-11-06T00:28:25.952ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
99502024-11-06T00:28:25.952ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
99512024-11-06T00:28:25.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99522024-11-06T00:28:25.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99532024-11-06T00:28:25.956ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
99542024-11-06T00:28:25.956ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
99552024-11-06T00:28:25.956ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-06 00:19:32.804378 UTC dns_group = internal generation = 1
99562024-11-06T00:28:25.956ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 155.226529ms iteration = 11 status = {"generation":1}
99572024-11-06T00:28:25.965ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
99582024-11-06T00:28:25.965ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99592024-11-06T00:28:25.965ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "18279b3f-8a1b-4bd3-9aa8-f22146c289e1", "content-length": "26", "date": "Wed, 06 Nov 2024 00:28:25 GMT"} })
99602024-11-06T00:28:25.965ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99612024-11-06T00:28:25.970ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99622024-11-06T00:28:25.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99632024-11-06T00:28:25.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99642024-11-06T00:28:25.977ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99652024-11-06T00:28:25.977ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
99662024-11-06T00:28:25.977ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 176.388797ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
99672024-11-06T00:28:25.983ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99682024-11-06T00:28:25.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
99692024-11-06T00:28:26.011ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
99702024-11-06T00:28:26.011ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 210.389716ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
99712024-11-06T00:28:26.027ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 226.266687ms iteration = 21 status = {"physical_disks_added":0}
99722024-11-06T00:28:26.044ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
99732024-11-06T00:28:26.084ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
99742024-11-06T00:28:26.084ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99752024-11-06T00:28:26.084ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "758d3786-c0c4-45b2-80e7-394acfcbafa9", "content-length": "26", "date": "Wed, 06 Nov 2024 00:28:25 GMT"} })
99762024-11-06T00:28:26.084ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99772024-11-06T00:28:26.086ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
99782024-11-06T00:28:26.095ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
99792024-11-06T00:28:26.096ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3673ea96-7dd2-409c-99cd-b89a1d717ffc", "date": "Wed, 06 Nov 2024 00:28:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99802024-11-06T00:28:26.096ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99812024-11-06T00:28:26.098ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "42926eb4-57ec-4fe3-a4bc-1ce0ece02612", "date": "Wed, 06 Nov 2024 00:28:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99822024-11-06T00:28:26.098ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99832024-11-06T00:28:26.100ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99842024-11-06T00:28:26.100ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 298.840043ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
99852024-11-06T00:28:26.108ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
99862024-11-06T00:28:26.108ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99872024-11-06T00:28:26.108ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8467c54-22d7-4ce6-9be5-abc98b02bdda", "content-length": "26", "date": "Wed, 06 Nov 2024 00:28:25 GMT"} })
99882024-11-06T00:28:26.108ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99892024-11-06T00:28:26.110ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99902024-11-06T00:28:26.122ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99912024-11-06T00:28:26.122ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99922024-11-06T00:28:26.123ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99932024-11-06T00:28:26.124ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99942024-11-06T00:28:26.127ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
99952024-11-06T00:28:26.127ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99962024-11-06T00:28:26.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
99972024-11-06T00:28:26.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
99982024-11-06T00:28:26.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99992024-11-06T00:28:26.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100002024-11-06T00:28:26.130ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
100012024-11-06T00:28:26.130ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
100022024-11-06T00:28:26.130ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-06 00:19:33.391850 UTC dns_group = external generation = 2
100032024-11-06T00:28:26.130ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 329.056989ms iteration = 11 status = {"generation":2}
100042024-11-06T00:28:26.134ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
100052024-11-06T00:28:26.134ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b70c891d-41ba-40c0-bb76-433e02e5b02c", "content-length": "1", "date": "Wed, 06 Nov 2024 00:28:25 GMT"} })
100062024-11-06T00:28:26.137ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100072024-11-06T00:28:26.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100082024-11-06T00:28:26.139ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 337.942964ms iteration = 19 status = null
100092024-11-06T00:28:26.163ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-06T00:19:22.736570Z, time_modified: 2024-11-06T00:19:22.736570Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }) }
100102024-11-06T00:28:26.163ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 362.07937ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]}},"default_endpoint":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
100112024-11-06T00:28:26.183ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
100122024-11-06T00:28:26.201ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 400.253524ms iteration = 19 status = {}
100132024-11-06T00:28:26.223ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5537bbba-8fc5-4e11-9ddd-d21d04798e9d", "content-length": "372", "date": "Wed, 06 Nov 2024 00:28:26 GMT"} })
100142024-11-06T00:28:26.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100152024-11-06T00:28:26.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100162024-11-06T00:28:26.226ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100172024-11-06T00:28:26.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100182024-11-06T00:28:26.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100192024-11-06T00:28:26.231ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
100202024-11-06T00:28:26.231ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100212024-11-06T00:28:26.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100222024-11-06T00:28:26.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100232024-11-06T00:28:26.235ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
100242024-11-06T00:28:26.235ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100252024-11-06T00:28:26.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100262024-11-06T00:28:26.236ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
100272024-11-06T00:28:26.237ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "eb6c31fd-af1f-4c48-bc75-6bd6af5c003b", "date": "Wed, 06 Nov 2024 00:28:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
100282024-11-06T00:28:26.237ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
100292024-11-06T00:28:26.238ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "906e0018-aeff-4981-84e3-15f1d500d6db", "date": "Wed, 06 Nov 2024 00:28:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
100302024-11-06T00:28:26.238ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
100312024-11-06T00:28:26.240ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1b4299a5-f9c8-4743-a4f4-408f473673fd", "date": "Wed, 06 Nov 2024 00:28:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
100322024-11-06T00:28:26.240ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
100332024-11-06T00:28:26.243ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
100342024-11-06T00:28:26.243ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 441.853779ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
100352024-11-06T00:28:26.245ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
100362024-11-06T00:28:26.245ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
100372024-11-06T00:28:26.245ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bd92b141-6cf5-4d0c-801e-130c04764dee", "date": "Wed, 06 Nov 2024 00:28:26 GMT"} })
100382024-11-06T00:28:26.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100392024-11-06T00:28:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100402024-11-06T00:28:26.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100412024-11-06T00:28:26.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100422024-11-06T00:28:26.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100432024-11-06T00:28:26.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100442024-11-06T00:28:26.255ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
100452024-11-06T00:28:26.255ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
100462024-11-06T00:28:26.255ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "41caaa6c-8371-4746-a5b6-3ea4f1b0cdaf", "date": "Wed, 06 Nov 2024 00:28:26 GMT"} })
100472024-11-06T00:28:26.257ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 456.431162ms iteration = 20 status = {}
100482024-11-06T00:28:26.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100492024-11-06T00:28:26.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100502024-11-06T00:28:26.278ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
100512024-11-06T00:28:26.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100522024-11-06T00:28:26.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100532024-11-06T00:28:26.288ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
100542024-11-06T00:28:26.288ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cb21917-d3ea-4986-b9ed-8370b61c0b34", "content-length": "121", "date": "Wed, 06 Nov 2024 00:28:26 GMT"} })
100552024-11-06T00:28:26.288ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
100562024-11-06T00:28:26.288ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
100572024-11-06T00:28:26.288ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
100582024-11-06T00:28:26.288ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
100592024-11-06T00:28:26.288ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100602024-11-06T00:28:26.288ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100612024-11-06T00:28:26.288ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100622024-11-06T00:28:26.288ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
100632024-11-06T00:28:26.289ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100642024-11-06T00:28:26.289ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
100652024-11-06T00:28:26.289ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
100662024-11-06T00:28:26.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100672024-11-06T00:28:26.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100682024-11-06T00:28:26.291ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
100692024-11-06T00:28:26.291ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3446288-ebf9-4fc9-afbf-ad4297511c70", "content-length": "2", "date": "Wed, 06 Nov 2024 00:28:26 GMT"} })
100702024-11-06T00:28:26.291ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
100712024-11-06T00:28:26.291ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c5f1d8b-5440-433b-a4fe-de8efea71de2", "content-length": "52", "date": "Wed, 06 Nov 2024 00:28:26 GMT"} })
100722024-11-06T00:28:26.291ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
100732024-11-06T00:28:26.291ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
100742024-11-06T00:28:26.333ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
100752024-11-06T00:28:26.399ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f3aed838-34e4-418e-9f4e-e14646c4f321", "date": "Wed, 06 Nov 2024 00:28:26 GMT"} })
100762024-11-06T00:28:26.399ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
100772024-11-06T00:28:26.399ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
100782024-11-06T00:28:26.399ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a281c15-8dd6-4643-be20-dfb8c9e0ba50", "content-length": "691", "date": "Wed, 06 Nov 2024 00:28:26 GMT"} })
100792024-11-06T00:28:26.399ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
100802024-11-06T00:28:26.399ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
100812024-11-06T00:28:26.399ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
100822024-11-06T00:28:26.399ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "355e3551-a6f0-4f20-978e-8952d82a8569", "content-length": "669", "date": "Wed, 06 Nov 2024 00:28:26 GMT"} })
100832024-11-06T00:28:26.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100842024-11-06T00:28:26.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100852024-11-06T00:28:26.402ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 600.827208ms iteration = 19 status = {}
100862024-11-06T00:28:26.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100872024-11-06T00:28:26.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100882024-11-06T00:28:26.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100892024-11-06T00:28:26.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100902024-11-06T00:28:26.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100912024-11-06T00:28:26.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100922024-11-06T00:28:26.417ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 616.048031ms iteration = 19 status = {}
100932024-11-06T00:28:29.098ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:57321
100942024-11-06T00:28:29.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57321 req_id = bc2e209f-d188-4383-9ce1-094d0f77e777 roles = RoleSet { roles: {} } uri = /metrics/producers
100952024-11-06T00:28:29.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57321 req_id = bc2e209f-d188-4383-9ce1-094d0f77e777 resource = Database result = Ok(()) uri = /metrics/producers
100962024-11-06T00:28:29.108ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = eeaea349-a304-4c2f-97f2-4ab76b77beee
100972024-11-06T00:28:29.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9683 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57321 req_id = bc2e209f-d188-4383-9ce1-094d0f77e777 response_code = 201 uri = /metrics/producers
100982024-11-06T00:28:31.471ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1567 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 25f3db33-9f20-4c66-9275-d756e87d2a5e response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
100992024-11-06T00:28:35.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
101002024-11-06T00:28:35.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101012024-11-06T00:28:35.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
101022024-11-06T00:28:35.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101032024-11-06T00:28:35.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101042024-11-06T00:28:35.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101052024-11-06T00:28:35.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101062024-11-06T00:28:35.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101072024-11-06T00:28:35.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101082024-11-06T00:28:35.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.120973ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101092024-11-06T00:28:35.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101102024-11-06T00:28:35.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101112024-11-06T00:28:35.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101122024-11-06T00:28:35.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101132024-11-06T00:28:35.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101142024-11-06T00:28:35.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101152024-11-06T00:28:35.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
101162024-11-06T00:28:35.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101172024-11-06T00:28:35.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101182024-11-06T00:28:35.819ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
101192024-11-06T00:28:35.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.765857ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
101202024-11-06T00:28:45.799ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
101212024-11-06T00:28:45.799ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
101222024-11-06T00:28:45.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101232024-11-06T00:28:45.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101242024-11-06T00:28:45.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101252024-11-06T00:28:45.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101262024-11-06T00:28:45.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101272024-11-06T00:28:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101282024-11-06T00:28:45.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101292024-11-06T00:28:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101302024-11-06T00:28:45.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101312024-11-06T00:28:45.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101322024-11-06T00:28:45.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101332024-11-06T00:28:45.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
101342024-11-06T00:28:45.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101352024-11-06T00:28:45.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101362024-11-06T00:28:45.819ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
101372024-11-06T00:28:45.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.136298ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
101382024-11-06T00:28:45.828ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101392024-11-06T00:28:45.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101402024-11-06T00:28:45.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.302672ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101412024-11-06T00:28:46.472ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1102 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 79433cae-add2-4ce6-b28a-b150739e8cfc response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
101422024-11-06T00:28:49.868ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:63770
101432024-11-06T00:28:49.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63770 req_id = 229e8066-4128-431a-acb4-e38c10830a34 roles = RoleSet { roles: {} } uri = /metrics/producers
101442024-11-06T00:28:49.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63770 req_id = 229e8066-4128-431a-acb4-e38c10830a34 resource = Database result = Ok(()) uri = /metrics/producers
101452024-11-06T00:28:49.907ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = 9c1a1f66-8a95-49da-beda-497b56ec3bbf
101462024-11-06T00:28:49.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39028 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63770 req_id = 229e8066-4128-431a-acb4-e38c10830a34 response_code = 201 uri = /metrics/producers
101472024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
101482024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101492024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
101502024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
101512024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.46\u{b5}s iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
101522024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101532024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
101542024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.84\u{b5}s iteration = 20 status = {"errors":[],"records_set_to_done":[]}
101552024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
101562024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
101572024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.41\u{b5}s iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
101582024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
101592024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
101602024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.87\u{b5}s iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
101612024-11-06T00:28:55.800ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
101622024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101632024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
101642024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101652024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
101662024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101672024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
101682024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101692024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
101702024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
101712024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
101722024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
101732024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101742024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101752024-11-06T00:28:55.800ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
101762024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101772024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
101782024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
101792024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
101802024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101812024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
101822024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101832024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101842024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101852024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101862024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101872024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
101882024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101892024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101902024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101912024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101922024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101932024-11-06T00:28:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101942024-11-06T00:28:55.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101952024-11-06T00:28:55.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101962024-11-06T00:28:55.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101972024-11-06T00:28:55.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101982024-11-06T00:28:55.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101992024-11-06T00:28:55.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.094921ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
102002024-11-06T00:28:55.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
102012024-11-06T00:28:55.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102022024-11-06T00:28:55.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102032024-11-06T00:28:55.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102042024-11-06T00:28:55.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102052024-11-06T00:28:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102062024-11-06T00:28:55.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102072024-11-06T00:28:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102082024-11-06T00:28:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102092024-11-06T00:28:55.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102102024-11-06T00:28:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102112024-11-06T00:28:55.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102122024-11-06T00:28:55.807ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1599, tv_nsec: 153134111 } })
102132024-11-06T00:28:55.808ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
102142024-11-06T00:28:55.809ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102152024-11-06T00:28:55.809ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102162024-11-06T00:28:55.809ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102172024-11-06T00:28:55.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102182024-11-06T00:28:55.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102192024-11-06T00:28:55.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102202024-11-06T00:28:55.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102212024-11-06T00:28:55.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102222024-11-06T00:28:55.810ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1599, tv_nsec: 155432809 } })
102232024-11-06T00:28:55.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102242024-11-06T00:28:55.810ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
102252024-11-06T00:28:55.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 10.11782ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102262024-11-06T00:28:55.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
102272024-11-06T00:28:55.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102282024-11-06T00:28:55.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
102292024-11-06T00:28:55.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102302024-11-06T00:28:55.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102312024-11-06T00:28:55.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102322024-11-06T00:28:55.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 12.83491ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102332024-11-06T00:28:55.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102342024-11-06T00:28:55.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102352024-11-06T00:28:55.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102362024-11-06T00:28:55.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102372024-11-06T00:28:55.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102382024-11-06T00:28:55.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102392024-11-06T00:28:55.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102402024-11-06T00:28:55.816ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1599, tv_nsec: 161663974 } })
102412024-11-06T00:28:55.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102422024-11-06T00:28:55.816ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
102432024-11-06T00:28:55.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102442024-11-06T00:28:55.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102452024-11-06T00:28:55.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102462024-11-06T00:28:55.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102472024-11-06T00:28:55.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102482024-11-06T00:28:55.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102492024-11-06T00:28:55.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102502024-11-06T00:28:55.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102512024-11-06T00:28:55.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102522024-11-06T00:28:55.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
102532024-11-06T00:28:55.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102542024-11-06T00:28:55.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102552024-11-06T00:28:55.836ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102562024-11-06T00:28:55.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102572024-11-06T00:28:55.843ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
102582024-11-06T00:28:55.843ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 42.585305ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
102592024-11-06T00:28:55.848ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102602024-11-06T00:28:55.848ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
102612024-11-06T00:28:55.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102622024-11-06T00:28:55.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102632024-11-06T00:28:55.890ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
102642024-11-06T00:28:55.890ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102652024-11-06T00:28:55.890ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd0ef513-0030-4806-997c-362bc8171b89", "content-length": "26", "date": "Wed, 06 Nov 2024 00:28:55 GMT"} })
102662024-11-06T00:28:55.890ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102672024-11-06T00:28:55.892ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102682024-11-06T00:28:55.904ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
102692024-11-06T00:28:55.904ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102702024-11-06T00:28:55.905ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
102712024-11-06T00:28:55.905ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102722024-11-06T00:28:55.905ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0aa8a331-ae4c-4db8-9ac3-ed396edd8256", "content-length": "26", "date": "Wed, 06 Nov 2024 00:28:55 GMT"} })
102732024-11-06T00:28:55.905ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102742024-11-06T00:28:55.905ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d69d7d24-36d1-4bd8-b5a8-4bd49dfdc845", "content-length": "26", "date": "Wed, 06 Nov 2024 00:28:55 GMT"} })
102752024-11-06T00:28:55.905ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102762024-11-06T00:28:55.907ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
102772024-11-06T00:28:55.908ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102782024-11-06T00:28:55.908ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
102792024-11-06T00:28:55.908ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102802024-11-06T00:28:55.909ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "583b93a3-8788-447c-a1d2-db64eab52518", "content-length": "372", "date": "Wed, 06 Nov 2024 00:28:55 GMT"} })
102812024-11-06T00:28:55.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102822024-11-06T00:28:55.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102832024-11-06T00:28:55.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102842024-11-06T00:28:55.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102852024-11-06T00:28:55.913ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 112.671846ms iteration = 22 status = {"physical_disks_added":0}
102862024-11-06T00:28:55.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102872024-11-06T00:28:55.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
102882024-11-06T00:28:55.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102892024-11-06T00:28:55.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102902024-11-06T00:28:55.918ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 117.506138ms iteration = 20 status = 0
102912024-11-06T00:28:55.920ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
102922024-11-06T00:28:55.920ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 119.422896ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
102932024-11-06T00:28:55.941ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102942024-11-06T00:28:55.941ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
102952024-11-06T00:28:55.941ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.332666ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
102962024-11-06T00:28:55.953ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
102972024-11-06T00:28:55.953ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
102982024-11-06T00:28:55.991ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 190.336321ms iteration = 20 status = {}
102992024-11-06T00:28:55.999ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
103002024-11-06T00:28:56.000ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bc4ad47-3743-4d1a-9ff8-c3db84e36c7e", "content-length": "1", "date": "Wed, 06 Nov 2024 00:28:55 GMT"} })
103012024-11-06T00:28:56.001ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103022024-11-06T00:28:56.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103032024-11-06T00:28:56.003ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 203.158042ms iteration = 20 status = null
103042024-11-06T00:28:56.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103052024-11-06T00:28:56.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103062024-11-06T00:28:56.006ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103072024-11-06T00:28:56.008ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103082024-11-06T00:28:56.008ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103092024-11-06T00:28:56.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103102024-11-06T00:28:56.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103112024-11-06T00:28:56.011ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103122024-11-06T00:28:56.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103132024-11-06T00:28:56.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103142024-11-06T00:28:56.064ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "dfcd3006-6054-4111-b6f5-3550244a330d", "date": "Wed, 06 Nov 2024 00:28:56 GMT"} })
103152024-11-06T00:28:56.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103162024-11-06T00:28:56.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103172024-11-06T00:28:56.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103182024-11-06T00:28:56.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103192024-11-06T00:28:56.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103202024-11-06T00:28:56.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103212024-11-06T00:28:56.074ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
103222024-11-06T00:28:56.075ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "629061e6-0f24-48cb-951f-56b032f46eee", "content-length": "691", "date": "Wed, 06 Nov 2024 00:28:55 GMT"} })
103232024-11-06T00:28:56.075ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
103242024-11-06T00:28:56.075ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
103252024-11-06T00:28:56.075ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
103262024-11-06T00:28:56.077ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103272024-11-06T00:28:56.077ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103282024-11-06T00:28:56.077ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 276.561321ms iteration = 20 status = {}
103292024-11-06T00:28:56.077ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "301984f5-afc5-4eaf-a70e-063ed8437c9e", "date": "Wed, 06 Nov 2024 00:28:55 GMT"} })
103302024-11-06T00:28:56.079ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 278.91142ms iteration = 21 status = {}
103312024-11-06T00:28:56.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103322024-11-06T00:28:56.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103332024-11-06T00:28:56.093ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
103342024-11-06T00:28:56.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103352024-11-06T00:28:56.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103362024-11-06T00:28:56.102ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103372024-11-06T00:28:56.102ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf34d041-2971-4e4f-9cc8-2c8de6daafb4", "content-length": "121", "date": "Wed, 06 Nov 2024 00:28:55 GMT"} })
103382024-11-06T00:28:56.102ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
103392024-11-06T00:28:56.102ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
103402024-11-06T00:28:56.103ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103412024-11-06T00:28:56.103ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103422024-11-06T00:28:56.103ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103432024-11-06T00:28:56.103ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103442024-11-06T00:28:56.103ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103452024-11-06T00:28:56.103ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103462024-11-06T00:28:56.103ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103472024-11-06T00:28:56.103ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103482024-11-06T00:28:56.103ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
103492024-11-06T00:28:56.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103502024-11-06T00:28:56.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103512024-11-06T00:28:56.105ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103522024-11-06T00:28:56.105ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c474951c-dd26-4b71-91e8-7e4164356a60", "content-length": "2", "date": "Wed, 06 Nov 2024 00:28:55 GMT"} })
103532024-11-06T00:28:56.105ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103542024-11-06T00:28:56.106ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8626f775-e06d-40e3-b5da-27ca3b364268", "content-length": "52", "date": "Wed, 06 Nov 2024 00:28:55 GMT"} })
103552024-11-06T00:28:56.106ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
103562024-11-06T00:28:56.106ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103572024-11-06T00:28:56.213ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ed08ad01-1717-4667-85c3-170173b061b5", "date": "Wed, 06 Nov 2024 00:28:55 GMT"} })
103582024-11-06T00:28:56.213ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
103592024-11-06T00:28:56.213ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103602024-11-06T00:28:56.213ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a306ed4f-db91-4b28-89fc-c56688a28b78", "content-length": "669", "date": "Wed, 06 Nov 2024 00:28:55 GMT"} })
103612024-11-06T00:28:56.213ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103622024-11-06T00:28:56.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103632024-11-06T00:28:56.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103642024-11-06T00:28:56.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103652024-11-06T00:28:56.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103662024-11-06T00:28:56.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103672024-11-06T00:28:56.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103682024-11-06T00:28:56.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103692024-11-06T00:28:56.230ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 429.415909ms iteration = 20 status = {}
103702024-11-06T00:28:59.174ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:44282
103712024-11-06T00:28:59.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44282 req_id = 02c6f69f-c236-4895-b25d-4d6c6c13e3e0 roles = RoleSet { roles: {} } uri = /metrics/producers
103722024-11-06T00:28:59.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44282 req_id = 02c6f69f-c236-4895-b25d-4d6c6c13e3e0 resource = Database result = Ok(()) uri = /metrics/producers
103732024-11-06T00:28:59.211ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = fed3ec74-af42-4df7-9f71-3957f7103dff
103742024-11-06T00:28:59.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36943 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44282 req_id = 02c6f69f-c236-4895-b25d-4d6c6c13e3e0 response_code = 201 uri = /metrics/producers
103752024-11-06T00:29:01.469ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1017 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 8434f5d5-39f3-4b94-b5d1-305f541c3053 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
103762024-11-06T00:29:05.799ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
103772024-11-06T00:29:05.799ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
103782024-11-06T00:29:05.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103792024-11-06T00:29:05.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103802024-11-06T00:29:05.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103812024-11-06T00:29:05.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103822024-11-06T00:29:05.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103832024-11-06T00:29:05.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103842024-11-06T00:29:05.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103852024-11-06T00:29:05.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103862024-11-06T00:29:05.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103872024-11-06T00:29:05.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103882024-11-06T00:29:05.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103892024-11-06T00:29:05.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103902024-11-06T00:29:05.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103912024-11-06T00:29:05.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
103922024-11-06T00:29:05.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103932024-11-06T00:29:05.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103942024-11-06T00:29:05.819ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
103952024-11-06T00:29:05.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.270332ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
103962024-11-06T00:29:05.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.924728ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103972024-11-06T00:29:06.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = f63d5a5b-c239-43a3-91b5-9b5488faf147 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
103982024-11-06T00:29:06.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = f63d5a5b-c239-43a3-91b5-9b5488faf147 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
103992024-11-06T00:29:06.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = f63d5a5b-c239-43a3-91b5-9b5488faf147 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
104002024-11-06T00:29:06.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 15fcff58-190a-436c-847a-988b7bc3cec5 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
104012024-11-06T00:29:06.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 15fcff58-190a-436c-847a-988b7bc3cec5 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
104022024-11-06T00:29:06.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53594 req_id = 15fcff58-190a-436c-847a-988b7bc3cec5 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
104032024-11-06T00:29:15.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
104042024-11-06T00:29:15.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104052024-11-06T00:29:15.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
104062024-11-06T00:29:15.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104072024-11-06T00:29:15.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104082024-11-06T00:29:15.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104092024-11-06T00:29:15.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104102024-11-06T00:29:15.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104112024-11-06T00:29:15.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104122024-11-06T00:29:15.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.00497ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104132024-11-06T00:29:15.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104142024-11-06T00:29:15.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104152024-11-06T00:29:15.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104162024-11-06T00:29:15.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104172024-11-06T00:29:15.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104182024-11-06T00:29:15.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104192024-11-06T00:29:15.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
104202024-11-06T00:29:15.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104212024-11-06T00:29:15.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104222024-11-06T00:29:15.819ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
104232024-11-06T00:29:15.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.498159ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
104242024-11-06T00:29:16.470ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1291 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 9f4827fe-9819-4561-a373-1165a41f4390 response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
104252024-11-06T00:29:25.337ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:64183
104262024-11-06T00:29:25.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64183 req_id = 3e52f004-6baa-4eb7-afb5-725a82f0036b roles = RoleSet { roles: {} } uri = /metrics/producers
104272024-11-06T00:29:25.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64183 req_id = 3e52f004-6baa-4eb7-afb5-725a82f0036b resource = Database result = Ok(()) uri = /metrics/producers
104282024-11-06T00:29:25.355ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = a6ef5eb9-ed97-44f5-b038-ae216d3973fd
104292024-11-06T00:29:25.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 18067 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64183 req_id = 3e52f004-6baa-4eb7-afb5-725a82f0036b response_code = 201 uri = /metrics/producers
104302024-11-06T00:29:25.799ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
104312024-11-06T00:29:25.800ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
104322024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
104332024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104342024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104352024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
104362024-11-06T00:29:25.800ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
104372024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
104382024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
104392024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
104402024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104412024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
104422024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104432024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104442024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
104452024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104462024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
104472024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
104482024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104492024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
104502024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
104512024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104522024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
104532024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
104542024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
104552024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
104562024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
104572024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
104582024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
104592024-11-06T00:29:25.800ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-06 00:19:25.800173295 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
104602024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
104612024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
104622024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104632024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
104642024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
104652024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
104662024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
104672024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
104682024-11-06T00:29:25.800ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
104692024-11-06T00:29:25.800ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
104702024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
104712024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
104722024-11-06T00:29:25.800ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
104732024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104742024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
104752024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104762024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104772024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
104782024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
104792024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
104802024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104812024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
104822024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
104832024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104842024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
104852024-11-06T00:29:25.800ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846
104862024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
104872024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.381\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846"}
104882024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
104892024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.84\u{b5}s iteration = 21 status = {"errors":[],"records_set_to_done":[]}
104902024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.71\u{b5}s iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
104912024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
104922024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
104932024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
104942024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.24\u{b5}s iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
104952024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
104962024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
104972024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
104982024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.54\u{b5}s iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
104992024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
105002024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105012024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
105022024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105032024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105042024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105052024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105062024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105072024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105082024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
105092024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105102024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105112024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105122024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
105132024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
105142024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105152024-11-06T00:29:25.800ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
105162024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
105172024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
105182024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105192024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105202024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105212024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105222024-11-06T00:29:25.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
105232024-11-06T00:29:25.801ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("309c9aef-da72-4f08-9f70-c20d80316472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1629, tv_nsec: 146841914 } })
105242024-11-06T00:29:25.801ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51df9631-cef5-49ae-8cfd-f0c05bdac388.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7102227a-61f8-4dda-a9a0-f6678fae71c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1629, tv_nsec: 146854614 } })
105252024-11-06T00:29:25.801ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
105262024-11-06T00:29:25.801ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.091303ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
105272024-11-06T00:29:25.801ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
105282024-11-06T00:29:25.801ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.242817ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
105292024-11-06T00:29:25.802ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105302024-11-06T00:29:25.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105312024-11-06T00:29:25.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105322024-11-06T00:29:25.804ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.497383ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
105332024-11-06T00:29:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
105342024-11-06T00:29:25.805ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
105352024-11-06T00:29:25.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
105362024-11-06T00:29:25.806ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
105372024-11-06T00:29:25.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105382024-11-06T00:29:25.807ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105392024-11-06T00:29:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105402024-11-06T00:29:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
105412024-11-06T00:29:25.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105422024-11-06T00:29:25.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105432024-11-06T00:29:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105442024-11-06T00:29:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105452024-11-06T00:29:25.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
105462024-11-06T00:29:25.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105472024-11-06T00:29:25.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105482024-11-06T00:29:25.810ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105492024-11-06T00:29:25.810ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
105502024-11-06T00:29:25.810ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105512024-11-06T00:29:25.810ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105522024-11-06T00:29:25.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105532024-11-06T00:29:25.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105542024-11-06T00:29:25.810ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105552024-11-06T00:29:25.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1629, tv_nsec: 157829900 } })
105562024-11-06T00:29:25.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
105572024-11-06T00:29:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
105582024-11-06T00:29:25.812ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
105592024-11-06T00:29:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
105602024-11-06T00:29:25.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105612024-11-06T00:29:25.816ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
105622024-11-06T00:29:25.816ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
105632024-11-06T00:29:25.816ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.627973ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
105642024-11-06T00:29:25.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
105652024-11-06T00:29:25.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105662024-11-06T00:29:25.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105672024-11-06T00:29:25.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105682024-11-06T00:29:25.820ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-06 00:19:25.800173295 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
105692024-11-06T00:29:25.820ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.834158ms iteration = 11 status = {"expiration":"2024-11-06T00:19:25.800173295Z","pruned":[]}
105702024-11-06T00:29:25.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105712024-11-06T00:29:25.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105722024-11-06T00:29:25.820ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105732024-11-06T00:29:25.821ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1629, tv_nsec: 166760755 } })
105742024-11-06T00:29:25.821ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
105752024-11-06T00:29:25.822ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.868369ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
105762024-11-06T00:29:25.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105772024-11-06T00:29:25.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105782024-11-06T00:29:25.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105792024-11-06T00:29:25.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
105802024-11-06T00:29:25.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105812024-11-06T00:29:25.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105822024-11-06T00:29:25.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105832024-11-06T00:29:25.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
105842024-11-06T00:29:25.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105852024-11-06T00:29:25.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105862024-11-06T00:29:25.827ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105872024-11-06T00:29:25.827ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105882024-11-06T00:29:25.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105892024-11-06T00:29:25.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105902024-11-06T00:29:25.828ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105912024-11-06T00:29:25.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105922024-11-06T00:29:25.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105932024-11-06T00:29:25.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105942024-11-06T00:29:25.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105952024-11-06T00:29:25.831ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105962024-11-06T00:29:25.831ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1629, tv_nsec: 176956808 } })
105972024-11-06T00:29:25.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105982024-11-06T00:29:25.831ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
105992024-11-06T00:29:25.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
106002024-11-06T00:29:25.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106012024-11-06T00:29:25.834ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106022024-11-06T00:29:25.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106032024-11-06T00:29:25.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106042024-11-06T00:29:25.838ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(2e32438c-b396-4de0-8fae-c5dba322a964, 0), (6798548e-560b-4da1-9692-f3b14b5b6fca, 0), (f16050de-5f20-4a74-8f6a-54e5add5803d, 0)]
106052024-11-06T00:29:25.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
106062024-11-06T00:29:25.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106072024-11-06T00:29:25.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106082024-11-06T00:29:25.839ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1629, tv_nsec: 185121220 } })
106092024-11-06T00:29:25.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106102024-11-06T00:29:25.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106112024-11-06T00:29:25.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106122024-11-06T00:29:25.847ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106132024-11-06T00:29:25.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106142024-11-06T00:29:25.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106152024-11-06T00:29:25.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106162024-11-06T00:29:25.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106172024-11-06T00:29:25.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106182024-11-06T00:29:25.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106192024-11-06T00:29:25.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106202024-11-06T00:29:25.864ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
106212024-11-06T00:29:25.864ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
106222024-11-06T00:29:25.864ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 64.072362ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
106232024-11-06T00:29:25.872ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
106242024-11-06T00:29:25.872ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.624016ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
106252024-11-06T00:29:25.873ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106262024-11-06T00:29:25.873ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
106272024-11-06T00:29:25.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106282024-11-06T00:29:25.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106292024-11-06T00:29:25.873ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
106302024-11-06T00:29:25.873ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
106312024-11-06T00:29:25.873ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
106322024-11-06T00:29:25.873ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
106332024-11-06T00:29:25.873ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 303eac8b-ad6a-45af-90d4-c4af71982f9a
106342024-11-06T00:29:25.873ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 64da5b3b-c863-4e6b-b806-ba0152e4a97a
106352024-11-06T00:29:25.873ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 6e5362cd-8504-4879-8873-1cba0ccb9b1f
106362024-11-06T00:29:25.880ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 80.48795ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
106372024-11-06T00:29:25.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106382024-11-06T00:29:25.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106392024-11-06T00:29:25.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106402024-11-06T00:29:25.883ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 83.827199ms iteration = 23 status = {"physical_disks_added":0}
106412024-11-06T00:29:25.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106422024-11-06T00:29:25.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
106432024-11-06T00:29:25.885ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106442024-11-06T00:29:25.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106452024-11-06T00:29:25.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106462024-11-06T00:29:25.887ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
106472024-11-06T00:29:25.887ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
106482024-11-06T00:29:25.887ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
106492024-11-06T00:29:25.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106502024-11-06T00:29:25.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106512024-11-06T00:29:25.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106522024-11-06T00:29:25.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106532024-11-06T00:29:25.889ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.716503ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106542024-11-06T00:29:25.890ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
106552024-11-06T00:29:25.890ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 90.492997ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
106562024-11-06T00:29:25.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
106572024-11-06T00:29:25.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106582024-11-06T00:29:25.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106592024-11-06T00:29:25.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106602024-11-06T00:29:25.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
106612024-11-06T00:29:25.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
106622024-11-06T00:29:25.901ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106632024-11-06T00:29:25.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106642024-11-06T00:29:25.903ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106652024-11-06T00:29:25.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106662024-11-06T00:29:25.904ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106672024-11-06T00:29:25.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
106682024-11-06T00:29:25.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106692024-11-06T00:29:25.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106702024-11-06T00:29:25.910ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106712024-11-06T00:29:25.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106722024-11-06T00:29:25.912ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106732024-11-06T00:29:25.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106742024-11-06T00:29:25.913ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106752024-11-06T00:29:25.913ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
106762024-11-06T00:29:25.913ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.211941ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
106772024-11-06T00:29:25.914ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106782024-11-06T00:29:25.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
106792024-11-06T00:29:25.919ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106802024-11-06T00:29:25.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 119.56993ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106812024-11-06T00:29:25.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106822024-11-06T00:29:25.922ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106832024-11-06T00:29:25.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106842024-11-06T00:29:25.925ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
106852024-11-06T00:29:25.925ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
106862024-11-06T00:29:25.925ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
106872024-11-06T00:29:25.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106882024-11-06T00:29:25.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106892024-11-06T00:29:25.927ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106902024-11-06T00:29:25.927ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106912024-11-06T00:29:25.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106922024-11-06T00:29:25.929ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
106932024-11-06T00:29:25.929ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
106942024-11-06T00:29:25.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106952024-11-06T00:29:25.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
106962024-11-06T00:29:25.930ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106972024-11-06T00:29:25.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106982024-11-06T00:29:25.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106992024-11-06T00:29:25.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107002024-11-06T00:29:25.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107012024-11-06T00:29:25.977ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
107022024-11-06T00:29:25.977ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 177.451559ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
107032024-11-06T00:29:25.982ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
107042024-11-06T00:29:25.983ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
107052024-11-06T00:29:25.983ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107062024-11-06T00:29:25.984ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c29b82c-e9d7-4a28-993c-d1056baf28a6", "content-length": "26", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107072024-11-06T00:29:25.984ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107082024-11-06T00:29:25.986ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107092024-11-06T00:29:26.052ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
107102024-11-06T00:29:26.052ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
107112024-11-06T00:29:26.052ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
107122024-11-06T00:29:26.053ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "5074e427-0e79-498b-9898-0ef427dd04d4", "content-length": "476", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107132024-11-06T00:29:26.053ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
107142024-11-06T00:29:26.053ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f45ed690-d7c4-41cb-89f2-4a728cec6e58", "content-length": "734", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107152024-11-06T00:29:26.053ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
107162024-11-06T00:29:26.053ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e81ff748-0603-4c17-8e40-794b5035fc1e", "content-length": "111", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107172024-11-06T00:29:26.053ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
107182024-11-06T00:29:26.054ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "558c48cd-4ae5-4d27-81e2-9c1da11952dd", "content-length": "111", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107192024-11-06T00:29:26.054ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
107202024-11-06T00:29:26.054ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1de3c046-825e-44f7-b35a-3aa256e339a2", "content-length": "167", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107212024-11-06T00:29:26.054ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
107222024-11-06T00:29:26.054ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "091530df-0d93-4092-982e-77ec28795912", "content-length": "167", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107232024-11-06T00:29:26.054ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
107242024-11-06T00:29:26.054ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "63737777-9b76-4e37-8ab9-17fccc3d3f7d", "content-length": "175", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107252024-11-06T00:29:26.054ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
107262024-11-06T00:29:26.055ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "00f03427-8c5f-4f9d-8b69-f7b83d167bc2", "content-length": "175", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107272024-11-06T00:29:26.055ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
107282024-11-06T00:29:26.055ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4ad44e2-5f6e-4586-be75-56aa9bd0233f", "content-length": "702", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107292024-11-06T00:29:26.055ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
107302024-11-06T00:29:26.055ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "833c7026-be3b-48eb-87c8-60f97209df36", "content-length": "727", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107312024-11-06T00:29:26.055ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
107322024-11-06T00:29:26.055ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b22ab9f3-aca1-482f-96c1-cc294e1736fd", "content-length": "729", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107332024-11-06T00:29:26.055ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
107342024-11-06T00:29:26.055ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "61171c84-3498-4b6d-a454-4ca1b1fa1b72", "content-length": "728", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107352024-11-06T00:29:26.055ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
107362024-11-06T00:29:26.056ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "455895a1-87bf-4b53-8a0a-01162fed4f36", "content-length": "722", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107372024-11-06T00:29:26.056ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
107382024-11-06T00:29:26.056ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "aaca03fa-9821-4ebd-9df3-0c1ccd12efac", "content-length": "109", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107392024-11-06T00:29:26.056ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
107402024-11-06T00:29:26.056ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e3a67d6-1eb0-4fa4-a56e-373fbcd33021", "content-length": "109", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107412024-11-06T00:29:26.056ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
107422024-11-06T00:29:26.057ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d30be7cf-7e49-4768-8af0-92009a610d1c", "content-length": "169", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107432024-11-06T00:29:26.057ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
107442024-11-06T00:29:26.057ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "24a9aa66-ec5c-46ab-b1cf-1937bac4825d", "content-length": "169", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107452024-11-06T00:29:26.057ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
107462024-11-06T00:29:26.057ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "08ede843-59db-410a-927c-c30eadbaa243", "content-length": "178", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107472024-11-06T00:29:26.057ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
107482024-11-06T00:29:26.058ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dc4fe81-1c07-4874-87a6-fe2d9b998408", "content-length": "178", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107492024-11-06T00:29:26.058ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
107502024-11-06T00:29:26.058ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ead9a72-1368-4b89-9d53-22a64657b629", "content-length": "702", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107512024-11-06T00:29:26.058ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
107522024-11-06T00:29:26.058ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "579ed2aa-3f55-4c67-a920-021f5bfb92b8", "content-length": "727", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107532024-11-06T00:29:26.058ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
107542024-11-06T00:29:26.058ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f2a53a7-6f19-4b60-9e2e-3be3773f8b56", "content-length": "729", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107552024-11-06T00:29:26.058ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
107562024-11-06T00:29:26.058ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d394025-80b3-4d7d-85cd-1569176e2ba1", "content-length": "728", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
107572024-11-06T00:29:26.058ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
107582024-11-06T00:29:26.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
107592024-11-06T00:29:26.126ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
107602024-11-06T00:29:26.126ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107612024-11-06T00:29:26.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107622024-11-06T00:29:26.129ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107632024-11-06T00:29:26.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107642024-11-06T00:29:26.129ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107652024-11-06T00:29:26.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107662024-11-06T00:29:26.130ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 330.101291ms iteration = 21 status = 0
107672024-11-06T00:29:26.130ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9407faa7-a722-48ab-8bff-01b82fc3a516", "content-length": "372", "date": "Wed, 06 Nov 2024 00:29:26 GMT"} })
107682024-11-06T00:29:26.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107692024-11-06T00:29:26.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107702024-11-06T00:29:26.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
107712024-11-06T00:29:26.132ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107722024-11-06T00:29:26.132ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
107732024-11-06T00:29:26.132ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107742024-11-06T00:29:26.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107752024-11-06T00:29:26.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107762024-11-06T00:29:26.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107772024-11-06T00:29:26.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107782024-11-06T00:29:26.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107792024-11-06T00:29:26.134ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107802024-11-06T00:29:26.134ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107812024-11-06T00:29:26.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107822024-11-06T00:29:26.135ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
107832024-11-06T00:29:26.135ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
107842024-11-06T00:29:26.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
107852024-11-06T00:29:26.139ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107862024-11-06T00:29:26.139ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
107872024-11-06T00:29:26.139ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
107882024-11-06T00:29:26.139ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-06 00:19:33.391850 UTC dns_group = external generation = 2
107892024-11-06T00:29:26.139ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 339.016945ms iteration = 12 status = {"generation":2}
107902024-11-06T00:29:26.139ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107912024-11-06T00:29:26.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107922024-11-06T00:29:26.141ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
107932024-11-06T00:29:26.141ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
107942024-11-06T00:29:26.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
107952024-11-06T00:29:26.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107962024-11-06T00:29:26.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107972024-11-06T00:29:26.145ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107982024-11-06T00:29:26.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107992024-11-06T00:29:26.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108002024-11-06T00:29:26.150ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
108012024-11-06T00:29:26.150ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108022024-11-06T00:29:26.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108032024-11-06T00:29:26.152ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108042024-11-06T00:29:26.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108052024-11-06T00:29:26.154ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
108062024-11-06T00:29:26.154ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108072024-11-06T00:29:26.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108082024-11-06T00:29:26.160ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108092024-11-06T00:29:26.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108102024-11-06T00:29:26.164ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108112024-11-06T00:29:26.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108122024-11-06T00:29:26.165ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108132024-11-06T00:29:26.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108142024-11-06T00:29:26.167ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108152024-11-06T00:29:26.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108162024-11-06T00:29:26.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108172024-11-06T00:29:26.174ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
108182024-11-06T00:29:26.174ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108192024-11-06T00:29:26.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108202024-11-06T00:29:26.175ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108212024-11-06T00:29:26.175ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108222024-11-06T00:29:26.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108232024-11-06T00:29:26.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108242024-11-06T00:29:26.176ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-06T00:19:22.736570Z, time_modified: 2024-11-06T00:19:22.736570Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }) }
108252024-11-06T00:29:26.176ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 376.951631ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]}},"default_endpoint":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
108262024-11-06T00:29:26.177ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
108272024-11-06T00:29:26.178ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
108282024-11-06T00:29:26.178ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
108292024-11-06T00:29:26.178ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108302024-11-06T00:29:26.178ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108312024-11-06T00:29:26.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108322024-11-06T00:29:26.180ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 379.951491ms iteration = 21 status = {}
108332024-11-06T00:29:26.181ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108342024-11-06T00:29:26.181ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108352024-11-06T00:29:26.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108362024-11-06T00:29:26.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108372024-11-06T00:29:26.185ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108382024-11-06T00:29:26.186ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108392024-11-06T00:29:26.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
108402024-11-06T00:29:26.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108412024-11-06T00:29:26.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108422024-11-06T00:29:26.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108432024-11-06T00:29:26.188ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108442024-11-06T00:29:26.188ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108452024-11-06T00:29:26.188ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108462024-11-06T00:29:26.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108472024-11-06T00:29:26.189ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
108482024-11-06T00:29:26.189ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
108492024-11-06T00:29:26.189ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
108502024-11-06T00:29:26.189ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
108512024-11-06T00:29:26.189ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-06 00:19:32.804378 UTC dns_group = internal generation = 1
108522024-11-06T00:29:26.189ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 389.641408ms iteration = 12 status = {"generation":1}
108532024-11-06T00:29:26.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
108542024-11-06T00:29:26.192ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108552024-11-06T00:29:26.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108562024-11-06T00:29:26.196ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2faf98d5-7ae0-47e1-8598-41bfe5d0b5be", "date": "Wed, 06 Nov 2024 00:29:26 GMT"} })
108572024-11-06T00:29:26.196ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108582024-11-06T00:29:26.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108592024-11-06T00:29:26.198ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108602024-11-06T00:29:26.199ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108612024-11-06T00:29:26.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108622024-11-06T00:29:26.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108632024-11-06T00:29:26.200ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108642024-11-06T00:29:26.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108652024-11-06T00:29:26.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108662024-11-06T00:29:26.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108672024-11-06T00:29:26.202ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108682024-11-06T00:29:26.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108692024-11-06T00:29:26.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108702024-11-06T00:29:26.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108712024-11-06T00:29:26.206ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
108722024-11-06T00:29:26.206ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108732024-11-06T00:29:26.208ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108742024-11-06T00:29:26.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108752024-11-06T00:29:26.209ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108762024-11-06T00:29:26.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108772024-11-06T00:29:26.211ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108782024-11-06T00:29:26.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108792024-11-06T00:29:26.213ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108802024-11-06T00:29:26.217ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
108812024-11-06T00:29:26.217ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108822024-11-06T00:29:26.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108832024-11-06T00:29:26.218ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108842024-11-06T00:29:26.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108852024-11-06T00:29:26.220ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b7184525-625d-4e1e-910c-9a7b70eaa113", "date": "Wed, 06 Nov 2024 00:29:26 GMT"} })
108862024-11-06T00:29:26.220ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108872024-11-06T00:29:26.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108882024-11-06T00:29:26.222ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108892024-11-06T00:29:26.223ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 423.263136ms iteration = 22 status = {}
108902024-11-06T00:29:26.228ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
108912024-11-06T00:29:26.228ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108922024-11-06T00:29:26.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108932024-11-06T00:29:26.232ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
108942024-11-06T00:29:26.232ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108952024-11-06T00:29:26.232ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0da4b81-8f75-4d1b-bfc7-f2cc8a762c09", "content-length": "26", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
108962024-11-06T00:29:26.232ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108972024-11-06T00:29:26.233ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
108982024-11-06T00:29:26.233ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108992024-11-06T00:29:26.234ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9534827-3d98-4ad4-95dc-cf5d09c476b3", "content-length": "26", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
109002024-11-06T00:29:26.234ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109012024-11-06T00:29:26.234ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109022024-11-06T00:29:26.236ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
109032024-11-06T00:29:26.236ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 37bbd7b6-d736-4142-9ad8-60e594545f3d, kind: Service { id: f13e9b98-ae91-4d61-ba9b-3b178cfa151a }, name: Name("nexus-f13e9b98-ae91-4d61-ba9b-3b178cfa151a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acdf8cb7-85f2-4777-8bd4-f403275388d3, kind: Service { id: f633068a-05f8-4be2-a65b-d83ac560f7a9 }, name: Name("nexus-f633068a-05f8-4be2-a65b-d83ac560f7a9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6096ff9-4d2b-4b07-af5b-bb3cff616f69, kind: Service { id: e2378399-e8ed-453c-847a-0a419dfd0966 }, name: Name("nexus-e2378399-e8ed-453c-847a-0a419dfd0966"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 5bdcd428-292d-4d10-9115-282b4950a6c7, kind: Service { id: 309c9aef-da72-4f08-9f70-c20d80316472 }, name: Name("external-dns-309c9aef-da72-4f08-9f70-c20d80316472"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bddae3f-1834-4c3e-96a7-d7374171c136, kind: Service { id: 9bf7f7e3-0a6c-48b6-84be-c4bb8425f761 }, name: Name("external-dns-9bf7f7e3-0a6c-48b6-84be-c4bb8425f761"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
109042024-11-06T00:29:26.236ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109052024-11-06T00:29:26.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109062024-11-06T00:29:26.329ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
109072024-11-06T00:29:26.329ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7a59a59e-1749-475b-b6ba-0ec5b89cb5ab", "date": "Wed, 06 Nov 2024 00:29:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
109082024-11-06T00:29:26.329ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
109092024-11-06T00:29:26.331ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "19ab30be-37b8-45d3-9672-1aa389804c3b", "date": "Wed, 06 Nov 2024 00:29:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
109102024-11-06T00:29:26.331ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
109112024-11-06T00:29:26.333ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "919ed505-54ce-4251-8cc0-8fcf7a05295e", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
109122024-11-06T00:29:26.333ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
109132024-11-06T00:29:26.335ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
109142024-11-06T00:29:26.335ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 535.772797ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
109152024-11-06T00:29:26.376ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
109162024-11-06T00:29:26.376ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
109172024-11-06T00:29:26.378ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109182024-11-06T00:29:26.380ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
109192024-11-06T00:29:26.380ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109202024-11-06T00:29:26.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109212024-11-06T00:29:26.383ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
109222024-11-06T00:29:26.383ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5bdcd428-292d-4d10-9115-282b4950a6c7, kind: Service { id: 309c9aef-da72-4f08-9f70-c20d80316472 }, name: Name("external-dns-309c9aef-da72-4f08-9f70-c20d80316472"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bddae3f-1834-4c3e-96a7-d7374171c136, kind: Service { id: 9bf7f7e3-0a6c-48b6-84be-c4bb8425f761 }, name: Name("external-dns-9bf7f7e3-0a6c-48b6-84be-c4bb8425f761"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 37bbd7b6-d736-4142-9ad8-60e594545f3d, kind: Service { id: f13e9b98-ae91-4d61-ba9b-3b178cfa151a }, name: Name("nexus-f13e9b98-ae91-4d61-ba9b-3b178cfa151a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acdf8cb7-85f2-4777-8bd4-f403275388d3, kind: Service { id: f633068a-05f8-4be2-a65b-d83ac560f7a9 }, name: Name("nexus-f633068a-05f8-4be2-a65b-d83ac560f7a9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6096ff9-4d2b-4b07-af5b-bb3cff616f69, kind: Service { id: e2378399-e8ed-453c-847a-0a419dfd0966 }, name: Name("nexus-e2378399-e8ed-453c-847a-0a419dfd0966"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
109232024-11-06T00:29:26.383ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
109242024-11-06T00:29:26.436ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
109252024-11-06T00:29:26.436ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "63205ef4-21ad-4ea3-963c-9dd45674ec29", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
109262024-11-06T00:29:26.436ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
109272024-11-06T00:29:26.437ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "903c0491-2838-4690-9d84-f4cb2068e49b", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
109282024-11-06T00:29:26.437ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
109292024-11-06T00:29:26.439ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
109302024-11-06T00:29:26.439ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 639.189167ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
109312024-11-06T00:29:26.473ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
109322024-11-06T00:29:26.478ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "42e035f5-18ce-475c-bb03-2874e31c7d16", "content-length": "691", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
109332024-11-06T00:29:26.478ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
109342024-11-06T00:29:26.478ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
109352024-11-06T00:29:26.478ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
109362024-11-06T00:29:26.480ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 680.911596ms iteration = 21 status = {}
109372024-11-06T00:29:26.484ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
109382024-11-06T00:29:26.484ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4018499b-93ef-42a8-a723-1c25e1a6f371", "content-length": "1", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
109392024-11-06T00:29:26.485ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109402024-11-06T00:29:26.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
109412024-11-06T00:29:26.488ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 688.225603ms iteration = 21 status = null
109422024-11-06T00:29:26.499ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 7c647f25-eb29-494d-840d-11658133af45, time_created: 2024-11-06T00:19:28.362863Z, time_modified: 2024-11-06T00:19:28.362863Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
109432024-11-06T00:29:26.499ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
109442024-11-06T00:29:26.499ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109452024-11-06T00:29:26.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109462024-11-06T00:29:26.501ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109472024-11-06T00:29:26.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109482024-11-06T00:29:26.503ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109492024-11-06T00:29:26.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
109502024-11-06T00:29:26.563ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
109512024-11-06T00:29:26.564ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "9c84c94e-5aff-40a1-98e0-15aad39e242f", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
109522024-11-06T00:29:26.565ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
109532024-11-06T00:29:26.565ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 764.741504ms
109542024-11-06T00:29:26.565ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 764.750895ms iteration = 3 status = {}
109552024-11-06T00:29:26.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109562024-11-06T00:29:26.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109572024-11-06T00:29:26.575ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
109582024-11-06T00:29:26.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109592024-11-06T00:29:26.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109602024-11-06T00:29:26.584ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
109612024-11-06T00:29:26.585ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8069f29d-c07a-46f7-8323-e17965937353", "content-length": "121", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
109622024-11-06T00:29:26.585ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
109632024-11-06T00:29:26.585ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
109642024-11-06T00:29:26.585ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
109652024-11-06T00:29:26.585ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
109662024-11-06T00:29:26.585ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109672024-11-06T00:29:26.585ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109682024-11-06T00:29:26.585ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109692024-11-06T00:29:26.585ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109702024-11-06T00:29:26.585ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109712024-11-06T00:29:26.585ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109722024-11-06T00:29:26.585ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
109732024-11-06T00:29:26.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109742024-11-06T00:29:26.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109752024-11-06T00:29:26.588ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
109762024-11-06T00:29:26.588ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8e31fbf-59f2-41ff-8410-5a606d8e071c", "content-length": "2", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
109772024-11-06T00:29:26.588ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
109782024-11-06T00:29:26.588ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "97508c73-d101-437b-b3a2-6cc16c7001e7", "content-length": "52", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
109792024-11-06T00:29:26.588ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
109802024-11-06T00:29:26.588ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
109812024-11-06T00:29:26.631ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e685253-bc66-4f33-9c17-82910199b906", "content-length": "29193", "date": "Wed, 06 Nov 2024 00:29:26 GMT"} })
109822024-11-06T00:29:26.633ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
109832024-11-06T00:29:26.635ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
109842024-11-06T00:29:26.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
109852024-11-06T00:29:26.637ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109862024-11-06T00:29:26.639ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
109872024-11-06T00:29:26.639ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
109882024-11-06T00:29:26.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
109892024-11-06T00:29:26.708ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9730ba89-afba-486d-8f17-0655da13aaf9", "date": "Wed, 06 Nov 2024 00:29:25 GMT"} })
109902024-11-06T00:29:26.708ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
109912024-11-06T00:29:26.708ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
109922024-11-06T00:29:26.709ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0142cd9f-c707-4eb5-aa50-f7484da645a7", "content-length": "669", "date": "Wed, 06 Nov 2024 00:29:26 GMT"} })
109932024-11-06T00:29:26.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109942024-11-06T00:29:26.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109952024-11-06T00:29:26.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109962024-11-06T00:29:26.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109972024-11-06T00:29:26.717ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109982024-11-06T00:29:26.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109992024-11-06T00:29:26.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110002024-11-06T00:29:26.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110012024-11-06T00:29:26.727ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 926.837067ms iteration = 21 status = {}
110022024-11-06T00:29:26.814ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = f1259c20-0678-4ffb-a071-63ead7d86419 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
110032024-11-06T00:29:26.814ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = f1259c20-0678-4ffb-a071-63ead7d86419 time_started = 2024-11-06 00:29:26.052805 UTC
110042024-11-06T00:29:26.814ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.014053967s iteration = 3 status = {"collection_id":"f1259c20-0678-4ffb-a071-63ead7d86419","time_done":"2024-11-06 00:29:26.633451 UTC","time_started":"2024-11-06 00:29:26.052805 UTC"}
110052024-11-06T00:29:26.814ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
110062024-11-06T00:29:26.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110072024-11-06T00:29:26.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110082024-11-06T00:29:26.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110092024-11-06T00:29:26.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110102024-11-06T00:29:26.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110112024-11-06T00:29:26.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110122024-11-06T00:29:26.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110132024-11-06T00:29:26.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110142024-11-06T00:29:26.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110152024-11-06T00:29:26.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110162024-11-06T00:29:26.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110172024-11-06T00:29:26.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110182024-11-06T00:29:26.951ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 137.290096ms iteration = 24 status = {"physical_disks_added":0}
110192024-11-06T00:29:31.474ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1031 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 39a7aadc-06c2-4446-930e-bdc6ebadec7a response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
110202024-11-06T00:29:34.933ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
110212024-11-06T00:29:34.933ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
110222024-11-06T00:29:34.963ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
110232024-11-06T00:29:34.963ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:41272
110242024-11-06T00:29:34.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:41272 req_id = 38a4c46c-1dfd-4038-9fa6-9396a2ddbc9c roles = RoleSet { roles: {} } uri = /metrics/producers
110252024-11-06T00:29:34.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:41272 req_id = 38a4c46c-1dfd-4038-9fa6-9396a2ddbc9c resource = Database result = Ok(()) uri = /metrics/producers
110262024-11-06T00:29:35.000ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = e2378399-e8ed-453c-847a-0a419dfd0966
110272024-11-06T00:29:35.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36904 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:41272 req_id = 38a4c46c-1dfd-4038-9fa6-9396a2ddbc9c response_code = 201 uri = /metrics/producers
110282024-11-06T00:29:35.000ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "38a4c46c-1dfd-4038-9fa6-9396a2ddbc9c", "content-length": "41", "date": "Wed, 06 Nov 2024 00:29:34 GMT"} })
110292024-11-06T00:29:35.001ZDEBGnexus (producer-registration-task): registered with nexus successfully
110302024-11-06T00:29:35.002ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
110312024-11-06T00:29:35.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
110322024-11-06T00:29:35.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110332024-11-06T00:29:35.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
110342024-11-06T00:29:35.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110352024-11-06T00:29:35.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110362024-11-06T00:29:35.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110372024-11-06T00:29:35.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110382024-11-06T00:29:35.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110392024-11-06T00:29:35.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110402024-11-06T00:29:35.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110412024-11-06T00:29:35.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110422024-11-06T00:29:35.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110432024-11-06T00:29:35.828ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110442024-11-06T00:29:35.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110452024-11-06T00:29:35.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110462024-11-06T00:29:35.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
110472024-11-06T00:29:35.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110482024-11-06T00:29:35.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110492024-11-06T00:29:35.852ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
110502024-11-06T00:29:35.852ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.191519ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
110512024-11-06T00:29:35.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.157585ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110522024-11-06T00:29:45.799ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
110532024-11-06T00:29:45.799ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
110542024-11-06T00:29:45.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110552024-11-06T00:29:45.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110562024-11-06T00:29:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110572024-11-06T00:29:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110582024-11-06T00:29:45.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110592024-11-06T00:29:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110602024-11-06T00:29:45.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110612024-11-06T00:29:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110622024-11-06T00:29:45.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110632024-11-06T00:29:45.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110642024-11-06T00:29:45.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110652024-11-06T00:29:45.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
110662024-11-06T00:29:45.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110672024-11-06T00:29:45.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110682024-11-06T00:29:45.820ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
110692024-11-06T00:29:45.820ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.495398ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
110702024-11-06T00:29:45.829ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110712024-11-06T00:29:45.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110722024-11-06T00:29:45.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.417673ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110732024-11-06T00:29:46.470ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1208 local_addr = [fd00:1122:3344:101::b]:35909 method = GET remote_addr = [fd00:1122:3344:101::d]:40170 req_id = 4c53a478-22c4-4aa3-8d82-5b1bc49beb3b response_code = 200 uri = /e2378399-e8ed-453c-847a-0a419dfd0966
110742024-11-06T00:29:48.803ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:34364
110752024-11-06T00:29:48.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34364 req_id = f589fe8a-2d9b-4242-9ed2-d7383bbe4ec4 roles = RoleSet { roles: {} } uri = /metrics/producers
110762024-11-06T00:29:48.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34364 req_id = f589fe8a-2d9b-4242-9ed2-d7383bbe4ec4 resource = Database result = Ok(()) uri = /metrics/producers
110772024-11-06T00:29:48.845ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = 57aed6c0-b7d9-4021-84f4-804ca56d1b7a
110782024-11-06T00:29:48.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42396 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34364 req_id = f589fe8a-2d9b-4242-9ed2-d7383bbe4ec4 response_code = 201 uri = /metrics/producers
110792024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
110802024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 21.031\u{b5}s iteration = 22 status = {"errors":[],"records_set_to_done":[]}
110812024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
110822024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
110832024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110842024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
110852024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
110862024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
110872024-11-06T00:29:55.799ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
110882024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110892024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110902024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110912024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
110922024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
110932024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 14.95\u{b5}s iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
110942024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.95\u{b5}s iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
110952024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
110962024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
110972024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
110982024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.02\u{b5}s iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
110992024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
111002024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111012024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111022024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
111032024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
111042024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111052024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
111062024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
111072024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
111082024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
111092024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111102024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
111112024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
111122024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111132024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
111142024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111152024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111162024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
111172024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111182024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
111192024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
111202024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111212024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111222024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
111232024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111242024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111252024-11-06T00:29:55.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111262024-11-06T00:29:55.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111272024-11-06T00:29:55.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111282024-11-06T00:29:55.802ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.877515ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
111292024-11-06T00:29:55.802ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1659, tv_nsec: 148736880 } })
111302024-11-06T00:29:55.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111312024-11-06T00:29:55.802ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
111322024-11-06T00:29:55.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111332024-11-06T00:29:55.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111342024-11-06T00:29:55.804ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1659, tv_nsec: 150546744 } })
111352024-11-06T00:29:55.804ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
111362024-11-06T00:29:55.805ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111372024-11-06T00:29:55.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111382024-11-06T00:29:55.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111392024-11-06T00:29:55.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
111402024-11-06T00:29:55.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
111412024-11-06T00:29:55.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
111422024-11-06T00:29:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111432024-11-06T00:29:55.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111442024-11-06T00:29:55.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111452024-11-06T00:29:55.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111462024-11-06T00:29:55.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111472024-11-06T00:29:55.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111482024-11-06T00:29:55.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111492024-11-06T00:29:55.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111502024-11-06T00:29:55.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111512024-11-06T00:29:55.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
111522024-11-06T00:29:55.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111532024-11-06T00:29:55.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111542024-11-06T00:29:55.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
111552024-11-06T00:29:55.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111562024-11-06T00:29:55.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111572024-11-06T00:29:55.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.17915ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111582024-11-06T00:29:55.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111592024-11-06T00:29:55.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111602024-11-06T00:29:55.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111612024-11-06T00:29:55.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111622024-11-06T00:29:55.817ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1659, tv_nsec: 163906671 } })
111632024-11-06T00:29:55.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111642024-11-06T00:29:55.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111652024-11-06T00:29:55.818ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
111662024-11-06T00:29:55.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111672024-11-06T00:29:55.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
111682024-11-06T00:29:55.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111692024-11-06T00:29:55.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111702024-11-06T00:29:55.832ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
111712024-11-06T00:29:55.832ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.198145ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
111722024-11-06T00:29:55.842ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111732024-11-06T00:29:55.842ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
111742024-11-06T00:29:55.842ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111752024-11-06T00:29:55.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111762024-11-06T00:29:55.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111772024-11-06T00:29:55.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111782024-11-06T00:29:55.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111792024-11-06T00:29:55.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
111802024-11-06T00:29:55.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111812024-11-06T00:29:55.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
111822024-11-06T00:29:55.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111832024-11-06T00:29:55.849ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111842024-11-06T00:29:55.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111852024-11-06T00:29:55.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111862024-11-06T00:29:55.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111872024-11-06T00:29:55.857ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
111882024-11-06T00:29:55.857ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.433725ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
111892024-11-06T00:29:55.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111902024-11-06T00:29:55.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111912024-11-06T00:29:55.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111922024-11-06T00:29:55.867ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 68.585846ms iteration = 25 status = {"physical_disks_added":0}
111932024-11-06T00:29:55.874ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111942024-11-06T00:29:55.876ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111952024-11-06T00:29:55.876ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
111962024-11-06T00:29:55.876ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111972024-11-06T00:29:55.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111982024-11-06T00:29:55.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
111992024-11-06T00:29:55.877ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112002024-11-06T00:29:55.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112012024-11-06T00:29:55.879ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.609703ms iteration = 22 status = 0
112022024-11-06T00:29:55.880ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
112032024-11-06T00:29:55.880ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112042024-11-06T00:29:55.880ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8377429-39e7-4a31-a13a-1abe7a34b06e", "content-length": "26", "date": "Wed, 06 Nov 2024 00:29:55 GMT"} })
112052024-11-06T00:29:55.881ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112062024-11-06T00:29:55.882ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
112072024-11-06T00:29:55.885ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
112082024-11-06T00:29:55.885ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112092024-11-06T00:29:55.885ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b152822-bb0d-4360-8610-1341bc9ff093", "content-length": "26", "date": "Wed, 06 Nov 2024 00:29:55 GMT"} })
112102024-11-06T00:29:55.885ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112112024-11-06T00:29:55.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.770906ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
112122024-11-06T00:29:55.887ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
112132024-11-06T00:29:55.895ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
112142024-11-06T00:29:55.895ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112152024-11-06T00:29:55.895ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d2b860a-e4de-463e-a429-d666f2a455b1", "content-length": "26", "date": "Wed, 06 Nov 2024 00:29:55 GMT"} })
112162024-11-06T00:29:55.895ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112172024-11-06T00:29:55.898ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
112182024-11-06T00:29:55.913ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112192024-11-06T00:29:55.913ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
112202024-11-06T00:29:55.913ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.443268ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
112212024-11-06T00:29:55.925ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112222024-11-06T00:29:55.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112232024-11-06T00:29:55.933ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112242024-11-06T00:29:55.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112252024-11-06T00:29:55.934ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112262024-11-06T00:29:55.937ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112272024-11-06T00:29:55.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112282024-11-06T00:29:55.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112292024-11-06T00:29:55.938ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112302024-11-06T00:29:55.941ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112312024-11-06T00:29:55.941ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112322024-11-06T00:29:55.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112332024-11-06T00:29:56.005ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 205.791219ms iteration = 22 status = {}
112342024-11-06T00:29:56.043ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
112352024-11-06T00:29:56.043ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
112362024-11-06T00:29:56.044ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "159f8495-8594-455f-98f3-5c49b6ba4cc9", "content-length": "372", "date": "Wed, 06 Nov 2024 00:29:56 GMT"} })
112372024-11-06T00:29:56.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112382024-11-06T00:29:56.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112392024-11-06T00:29:56.058ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
112402024-11-06T00:29:56.059ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5a6b2e3-4b34-48e6-ad53-28599889009b", "content-length": "1", "date": "Wed, 06 Nov 2024 00:29:55 GMT"} })
112412024-11-06T00:29:56.061ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112422024-11-06T00:29:56.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
112432024-11-06T00:29:56.063ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 264.459061ms iteration = 22 status = null
112442024-11-06T00:29:56.083ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
112452024-11-06T00:29:56.083ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
112462024-11-06T00:29:56.084ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9b7ad341-7740-4986-b61d-acff2e9272e7", "date": "Wed, 06 Nov 2024 00:29:56 GMT"} })
112472024-11-06T00:29:56.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112482024-11-06T00:29:56.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112492024-11-06T00:29:56.094ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
112502024-11-06T00:29:56.095ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "933ffbc2-935f-490b-8068-315b07161fac", "content-length": "691", "date": "Wed, 06 Nov 2024 00:29:56 GMT"} })
112512024-11-06T00:29:56.095ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
112522024-11-06T00:29:56.095ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
112532024-11-06T00:29:56.095ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
112542024-11-06T00:29:56.096ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 297.359788ms iteration = 22 status = {}
112552024-11-06T00:29:56.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112562024-11-06T00:29:56.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112572024-11-06T00:29:56.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112582024-11-06T00:29:56.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112592024-11-06T00:29:56.103ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
112602024-11-06T00:29:56.103ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
112612024-11-06T00:29:56.103ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a4bfbc31-9eb4-4c7b-9d54-478f2a16d445", "date": "Wed, 06 Nov 2024 00:29:56 GMT"} })
112622024-11-06T00:29:56.104ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 305.595903ms iteration = 23 status = {}
112632024-11-06T00:29:56.128ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112642024-11-06T00:29:56.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112652024-11-06T00:29:56.130ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
112662024-11-06T00:29:56.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112672024-11-06T00:29:56.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112682024-11-06T00:29:56.138ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
112692024-11-06T00:29:56.138ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbf68858-dd31-4835-a838-15f3fb870d72", "content-length": "121", "date": "Wed, 06 Nov 2024 00:29:55 GMT"} })
112702024-11-06T00:29:56.138ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
112712024-11-06T00:29:56.138ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
112722024-11-06T00:29:56.138ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
112732024-11-06T00:29:56.138ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
112742024-11-06T00:29:56.138ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112752024-11-06T00:29:56.138ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112762024-11-06T00:29:56.138ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112772024-11-06T00:29:56.138ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112782024-11-06T00:29:56.138ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112792024-11-06T00:29:56.138ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112802024-11-06T00:29:56.138ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
112812024-11-06T00:29:56.138ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112822024-11-06T00:29:56.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112832024-11-06T00:29:56.141ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
112842024-11-06T00:29:56.141ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fab7c18-4391-4721-8145-a4c181f827e8", "content-length": "2", "date": "Wed, 06 Nov 2024 00:29:55 GMT"} })
112852024-11-06T00:29:56.141ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
112862024-11-06T00:29:56.141ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "736ffd6b-e69e-4763-a38d-e1c8fce375c1", "content-length": "52", "date": "Wed, 06 Nov 2024 00:29:55 GMT"} })
112872024-11-06T00:29:56.141ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
112882024-11-06T00:29:56.141ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
112892024-11-06T00:29:56.242ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "79f817b7-b1b3-4346-84c6-e514da219c2e", "date": "Wed, 06 Nov 2024 00:29:56 GMT"} })
112902024-11-06T00:29:56.242ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
112912024-11-06T00:29:56.242ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
112922024-11-06T00:29:56.242ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "86207fd7-dd26-4cf7-99ea-b27aed01a76b", "content-length": "669", "date": "Wed, 06 Nov 2024 00:29:56 GMT"} })
112932024-11-06T00:29:56.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112942024-11-06T00:29:56.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112952024-11-06T00:29:56.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112962024-11-06T00:29:56.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112972024-11-06T00:29:56.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112982024-11-06T00:29:56.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112992024-11-06T00:29:56.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113002024-11-06T00:29:56.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113012024-11-06T00:29:56.262ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 462.812971ms iteration = 22 status = {}