Max level shown:
1 [ Sep 9 17:51:56 Enabled. ]
2 [ Sep 9 17:51:56 Rereading configuration. ]
3 [ Sep 9 17:51:58 Rereading configuration. ]
4 [ Sep 9 17:52:10 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Sep 9 17:52:10 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-09-09T17:52:10.546ZDEBGnexus: registered DTrace probes
82024-09-09T17:52:10.548ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:74
92024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
332024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
342024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
352024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
362024-09-09T17:52:10.556ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
372024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
382024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
392024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
402024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
412024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
422024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
432024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
442024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
452024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
462024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
472024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
482024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
492024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
502024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
512024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
522024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
532024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
542024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
552024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
562024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
572024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
582024-09-09T17:52:10.557ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
592024-09-09T17:52:10.557ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
602024-09-09T17:52:10.573ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:216
612024-09-09T17:52:10.576ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
622024-09-09T17:52:10.582ZINFOnexus (ServerContext): Setting up qorb pool from DNS dns_addrs = [\n [fd00:1122:3344:1::1]:53,\n [fd00:1122:3344:2::1]:53,\n [fd00:1122:3344:3::1]:53,\n [fd00:1122:3344:4::1]:53,\n [fd00:1122:3344:5::1]:53,\n] file = nexus/src/context.rs:265
632024-09-09T17:52:20.718ZINFOnexus: Database schema version is up to date desired_version = 93.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 93.0.0
642024-09-09T17:52:20.721ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
652024-09-09T17:52:20.722ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33662, tv_nsec: 330817823 } })
662024-09-09T17:52:20.722ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
672024-09-09T17:52:20.774ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
682024-09-09T17:52:20.774ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
692024-09-09T17:52:20.779ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "da68904c-1523-4b1b-96b7-f810ba3a5a78", "content-length": "26", "date": "Mon, 09 Sep 2024 17:52:20 GMT"} })
702024-09-09T17:52:20.779ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
712024-09-09T17:52:20.780ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
722024-09-09T17:52:20.814ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33662, tv_nsec: 423567907 } })
732024-09-09T17:52:20.815ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
742024-09-09T17:52:20.849ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
752024-09-09T17:52:20.849ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
762024-09-09T17:52:20.850ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c59747c6-34e0-4818-a3a1-9369b6eee680", "content-length": "26", "date": "Mon, 09 Sep 2024 17:52:20 GMT"} })
772024-09-09T17:52:20.850ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
782024-09-09T17:52:20.850ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
792024-09-09T17:52:20.933ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
802024-09-09T17:52:20.939ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
812024-09-09T17:52:20.939ZDEBGnexus (DataLoader): attempting to create built-in users
822024-09-09T17:52:20.939ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
832024-09-09T17:52:20.939ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
842024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /artifacts/{kind}/{name}/{version}
852024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks
862024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /bgtasks/activate
872024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks/view/{bgtask_name}
882024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request
892024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped
902024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress
912024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish
922024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start
932024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga
942024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete
952024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all
962024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id}
972024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id}
982024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/import
992024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/regenerate
1002024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/target
1012024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/target
1022024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /deployment/blueprints/target/enabled
1032024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent
1042024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /disks/{disk_id}
1052024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /instances/{instance_id}/migrate
1062024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/collectors
1072024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /metrics/collectors/{collector_id}/producers
1082024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/producers
1092024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /nat/ipv4/changeset/{from_gen}
1102024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /physical-disk/expunge
1112024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /probes/{sled}
1122024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /racks/{rack_id}/initialization-complete
1132024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas
1142024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas/{saga_id}
1152024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sled-agents/{sled_id}
1162024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}
1172024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update
1182024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/add
1192024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/expunge
1202024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sleds/uninitialized
1212024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /switch/{switch_id}
1222024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /vmms/{propolis_id}
1232024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent
1242024-09-09T17:52:20.952ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::c]:12221
1252024-09-09T17:52:20.952ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12221
1262024-09-09T17:52:20.956ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1272024-09-09T17:52:20.958ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1282024-09-09T17:52:21.091ZWARNnexus: Cannot look up rack: Object (of type ById(1068bc7e-e3ab-44f6-b097-299854b0081f)) not found: rack file = nexus/src/app/rack.rs:771
1292024-09-09T17:52:21.179ZINFOnexus (DataLoader): created 5 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1302024-09-09T17:52:21.179ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1312024-09-09T17:52:21.180ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1322024-09-09T17:52:21.180ZDEBGnexus (DataLoader): attempting to create built-in roles
1332024-09-09T17:52:21.180ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1342024-09-09T17:52:21.180ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1352024-09-09T17:52:21.345ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1362024-09-09T17:52:21.345ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1372024-09-09T17:52:21.346ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1382024-09-09T17:52:21.346ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1392024-09-09T17:52:21.346ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1402024-09-09T17:52:21.346ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1412024-09-09T17:52:21.349ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:34200
1422024-09-09T17:52:21.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34200 req_id = bf032e5c-3937-418d-a0fa-4697053892d4 roles = RoleSet { roles: {} } uri = /metrics/producers
1432024-09-09T17:52:21.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34200 req_id = bf032e5c-3937-418d-a0fa-4697053892d4 resource = Database result = Ok(()) uri = /metrics/producers
1442024-09-09T17:52:21.370ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:34384
1452024-09-09T17:52:21.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 7bf4982b-676a-4f39-a13a-42c9f45b95d7 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
1462024-09-09T17:52:21.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 7bf4982b-676a-4f39-a13a-42c9f45b95d7 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
1472024-09-09T17:52:21.432ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 81358 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34200 req_id = bf032e5c-3937-418d-a0fa-4697053892d4 response_code = 503 uri = /metrics/producers
1482024-09-09T17:52:21.447ZINFOnexus (DataLoader): created 4 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1492024-09-09T17:52:21.447ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1502024-09-09T17:52:21.448ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1512024-09-09T17:52:21.448ZDEBGnexus (DataLoader): attempting to create built-in silos
1522024-09-09T17:52:21.448ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1532024-09-09T17:52:21.448ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1542024-09-09T17:52:21.513ZINFOnexus (DataLoader): created 2 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1552024-09-09T17:52:21.513ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1562024-09-09T17:52:21.514ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1572024-09-09T17:52:21.566ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1582024-09-09T17:52:21.567ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1592024-09-09T17:52:21.568ZDEBGnexus (DataLoader): attempting to create built-in projects
1602024-09-09T17:52:21.568ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1612024-09-09T17:52:21.568ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1622024-09-09T17:52:21.573ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1632024-09-09T17:52:21.574ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1642024-09-09T17:52:22.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 7bf4982b-676a-4f39-a13a-42c9f45b95d7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
1652024-09-09T17:52:22.118ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 7bf4982b-676a-4f39-a13a-42c9f45b95d7 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
1662024-09-09T17:52:22.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 7bf4982b-676a-4f39-a13a-42c9f45b95d7 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
1672024-09-09T17:52:22.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 7bf4982b-676a-4f39-a13a-42c9f45b95d7 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
1682024-09-09T17:52:22.147ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1692024-09-09T17:52:22.147ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1702024-09-09T17:52:22.148ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1712024-09-09T17:52:22.150ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1722024-09-09T17:52:22.150ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1732024-09-09T17:52:22.150ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1742024-09-09T17:52:22.151ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1752024-09-09T17:52:22.151ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1762024-09-09T17:52:22.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 7bf4982b-676a-4f39-a13a-42c9f45b95d7 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
1772024-09-09T17:52:22.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 7bf4982b-676a-4f39-a13a-42c9f45b95d7 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
1782024-09-09T17:52:22.259ZINFOnexus (dropshot_internal): set cockroachdb setting actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:124 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 7bf4982b-676a-4f39-a13a-42c9f45b95d7 setting = cluster.preserve_downgrade_option uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete value = 22.1
1792024-09-09T17:52:22.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 7bf4982b-676a-4f39-a13a-42c9f45b95d7 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
1802024-09-09T17:52:22.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 7bf4982b-676a-4f39-a13a-42c9f45b95d7 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
1812024-09-09T17:52:22.262ZINFOnexus (dropshot_internal): request completed error_message_external = not found: rack with id "1068bc7e-e3ab-44f6-b097-299854b0081f" error_message_internal = not found: rack with id "1068bc7e-e3ab-44f6-b097-299854b0081f" file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 890950 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 7bf4982b-676a-4f39-a13a-42c9f45b95d7 response_code = 404 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
1822024-09-09T17:52:22.424ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:54284
1832024-09-09T17:52:22.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:54284 req_id = 545b4117-801b-431a-a6db-80ccb4030f31 roles = RoleSet { roles: {} } uri = /metrics/collectors
1842024-09-09T17:52:22.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:54284 req_id = 545b4117-801b-431a-a6db-80ccb4030f31 resource = Database result = Ok(()) uri = /metrics/collectors
1852024-09-09T17:52:22.455ZINFOnexus: registered new oximeter metric collection server address = [fd00:1122:3344:101::d]:12223 collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:88
1862024-09-09T17:52:22.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 30716 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:54284 req_id = 545b4117-801b-431a-a6db-80ccb4030f31 response_code = 204 uri = /metrics/collectors
1872024-09-09T17:52:22.514ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:54477
1882024-09-09T17:52:22.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54477 req_id = 0f159bd2-ece4-416f-a548-9042bba0b540 roles = RoleSet { roles: {} } uri = /metrics/collectors/fe9e311d-41c3-4a6e-8e3e-3fbb54dee639/producers?sort_by=id_ascending
1892024-09-09T17:52:22.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54477 req_id = 0f159bd2-ece4-416f-a548-9042bba0b540 resource = Database result = Ok(()) uri = /metrics/collectors/fe9e311d-41c3-4a6e-8e3e-3fbb54dee639/producers?sort_by=id_ascending
1902024-09-09T17:52:22.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54477 req_id = 0f159bd2-ece4-416f-a548-9042bba0b540 response_code = 200 uri = /metrics/collectors/fe9e311d-41c3-4a6e-8e3e-3fbb54dee639/producers?sort_by=id_ascending
1912024-09-09T17:52:22.664ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1922024-09-09T17:52:22.666ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1932024-09-09T17:52:22.666ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1942024-09-09T17:52:22.666ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1952024-09-09T17:52:22.691ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1962024-09-09T17:52:22.691ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1972024-09-09T17:52:22.692ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1982024-09-09T17:52:22.692ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1992024-09-09T17:52:22.692ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2002024-09-09T17:52:22.692ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2012024-09-09T17:52:22.704ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2022024-09-09T17:52:22.704ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2032024-09-09T17:52:22.706ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2042024-09-09T17:52:22.707ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2052024-09-09T17:52:22.708ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2062024-09-09T17:52:22.708ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2072024-09-09T17:52:22.710ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2082024-09-09T17:52:22.710ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2092024-09-09T17:52:22.750ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2102024-09-09T17:52:22.752ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2112024-09-09T17:52:22.752ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2122024-09-09T17:52:22.753ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2132024-09-09T17:52:22.754ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2142024-09-09T17:52:22.754ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2152024-09-09T17:52:22.755ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2162024-09-09T17:52:22.755ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2172024-09-09T17:52:22.757ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2182024-09-09T17:52:22.759ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2192024-09-09T17:52:22.759ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2202024-09-09T17:52:22.759ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2212024-09-09T17:52:22.815ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2222024-09-09T17:52:22.815ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2232024-09-09T17:52:22.817ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2242024-09-09T17:52:22.817ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2252024-09-09T17:52:22.820ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2262024-09-09T17:52:22.820ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2272024-09-09T17:52:22.822ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2282024-09-09T17:52:22.822ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2292024-09-09T17:52:22.824ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2302024-09-09T17:52:22.824ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2312024-09-09T17:52:22.825ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2322024-09-09T17:52:22.826ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2332024-09-09T17:52:22.827ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2342024-09-09T17:52:22.827ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2352024-09-09T17:52:22.828ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362024-09-09T17:52:22.831ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2372024-09-09T17:52:22.831ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382024-09-09T17:52:22.832ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2392024-09-09T17:52:22.833ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402024-09-09T17:52:22.833ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2412024-09-09T17:52:22.834ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2422024-09-09T17:52:22.834ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2432024-09-09T17:52:22.836ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2442024-09-09T17:52:22.839ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2452024-09-09T17:52:22.839ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2462024-09-09T17:52:22.839ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2472024-09-09T17:52:22.934ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2482024-09-09T17:52:22.934ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2492024-09-09T17:52:22.936ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2502024-09-09T17:52:22.937ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2512024-09-09T17:52:22.939ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2522024-09-09T17:52:22.939ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2532024-09-09T17:52:22.941ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2542024-09-09T17:52:22.944ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2552024-09-09T17:52:22.944ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2562024-09-09T17:52:22.944ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2572024-09-09T17:52:22.987ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2582024-09-09T17:52:22.987ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2592024-09-09T17:52:22.987ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2602024-09-09T17:52:22.989ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2612024-09-09T17:52:22.989ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2622024-09-09T17:52:22.991ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2632024-09-09T17:52:22.991ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2642024-09-09T17:52:22.993ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2652024-09-09T17:52:22.993ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2662024-09-09T17:52:22.994ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2672024-09-09T17:52:22.994ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2682024-09-09T17:52:22.996ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2692024-09-09T17:52:22.996ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2702024-09-09T17:52:22.997ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2712024-09-09T17:52:23.000ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2722024-09-09T17:52:23.000ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2732024-09-09T17:52:23.000ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2742024-09-09T17:52:23.001ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2752024-09-09T17:52:23.001ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2762024-09-09T17:52:23.002ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2772024-09-09T17:52:23.003ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2782024-09-09T17:52:23.004ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2792024-09-09T17:52:23.007ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2802024-09-09T17:52:23.007ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2812024-09-09T17:52:23.007ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2822024-09-09T17:52:23.009ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2832024-09-09T17:52:23.010ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2842024-09-09T17:52:23.011ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2852024-09-09T17:52:23.011ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2862024-09-09T17:52:23.012ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872024-09-09T17:52:23.013ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2882024-09-09T17:52:23.014ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892024-09-09T17:52:23.017ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2902024-09-09T17:52:23.017ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2912024-09-09T17:52:23.017ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2922024-09-09T17:52:23.091ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
2932024-09-09T17:52:23.091ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
2942024-09-09T17:52:23.093ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:252
2952024-09-09T17:52:23.093ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2962024-09-09T17:52:23.093ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972024-09-09T17:52:23.093ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2982024-09-09T17:52:23.105ZWARNnexus: Cannot look up rack: Object (of type ById(1068bc7e-e3ab-44f6-b097-299854b0081f)) not found: rack file = nexus/src/app/rack.rs:771
2992024-09-09T17:52:23.105ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3002024-09-09T17:52:23.106ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3012024-09-09T17:52:23.107ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3022024-09-09T17:52:23.107ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3032024-09-09T17:52:23.108ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3042024-09-09T17:52:23.108ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3052024-09-09T17:52:23.110ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3062024-09-09T17:52:23.110ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3072024-09-09T17:52:23.111ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3082024-09-09T17:52:23.111ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3092024-09-09T17:52:23.113ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3102024-09-09T17:52:23.115ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3112024-09-09T17:52:23.115ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3122024-09-09T17:52:23.115ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3132024-09-09T17:52:23.118ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3142024-09-09T17:52:23.118ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3152024-09-09T17:52:23.119ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3162024-09-09T17:52:23.119ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3172024-09-09T17:52:23.120ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3182024-09-09T17:52:23.120ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3192024-09-09T17:52:23.122ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3202024-09-09T17:52:23.124ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3212024-09-09T17:52:23.150ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3222024-09-09T17:52:23.151ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3232024-09-09T17:52:23.193ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3242024-09-09T17:52:23.194ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3252024-09-09T17:52:23.208ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3262024-09-09T17:52:23.209ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3272024-09-09T17:52:23.210ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3282024-09-09T17:52:23.210ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3292024-09-09T17:52:23.213ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3302024-09-09T17:52:23.213ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3312024-09-09T17:52:23.215ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3322024-09-09T17:52:23.217ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3332024-09-09T17:52:23.217ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3342024-09-09T17:52:23.218ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3352024-09-09T17:52:23.257ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3362024-09-09T17:52:23.257ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3372024-09-09T17:52:23.264ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3382024-09-09T17:52:23.264ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3392024-09-09T17:52:23.266ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3402024-09-09T17:52:23.266ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3412024-09-09T17:52:23.267ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3422024-09-09T17:52:23.267ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3432024-09-09T17:52:23.269ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3442024-09-09T17:52:23.271ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3452024-09-09T17:52:23.305ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3462024-09-09T17:52:23.306ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3472024-09-09T17:52:23.424ZERROnexus (DataLoader): gave up trying to populate built-in PopulateBuiltinVpcs error_message = InternalError { internal_message: "unexpected database error: Record not found" } file = nexus/src/populate.rs:126
3482024-09-09T17:52:23.424ZERROnexus: populate failed file = nexus/src/app/mod.rs:516
3492024-09-09T17:52:23.424ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:522
3502024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
3512024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
3522024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
3532024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
3542024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
3552024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
3562024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
3572024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
3582024-09-09T17:52:23.425ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:71 reason = no blueprint
3592024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
3602024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
3612024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
3622024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
3632024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
3642024-09-09T17:52:23.425ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3652024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3662024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3672024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
3682024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
3692024-09-09T17:52:23.425ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-09 17:42:23.425857184 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
3702024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3712024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3722024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3732024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
3742024-09-09T17:52:23.425ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
3752024-09-09T17:52:23.425ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3762024-09-09T17:52:23.426ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 106.671\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
3772024-09-09T17:52:23.426ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 43.811\u{b5}s iteration = 1 status = {"error":"no blueprint"}
3782024-09-09T17:52:23.426ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 7.22\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
3792024-09-09T17:52:23.426ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
3802024-09-09T17:52:23.426ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
3812024-09-09T17:52:23.426ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
3822024-09-09T17:52:23.426ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
3832024-09-09T17:52:23.426ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
3842024-09-09T17:52:23.426ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
3852024-09-09T17:52:23.426ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
3862024-09-09T17:52:23.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3872024-09-09T17:52:23.427ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
3882024-09-09T17:52:23.427ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
3892024-09-09T17:52:23.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3902024-09-09T17:52:23.427ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3912024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
3922024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
3932024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
3942024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3952024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
3962024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
3972024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
3982024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3992024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4002024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4012024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4022024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4032024-09-09T17:52:23.428ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4042024-09-09T17:52:23.428ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4052024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.834731ms iteration = 1 status = {"error":"no blueprint"}
4062024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4072024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4082024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4092024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4102024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4112024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4122024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4132024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4142024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4152024-09-09T17:52:23.428ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4162024-09-09T17:52:23.429ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4172024-09-09T17:52:23.429ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4182024-09-09T17:52:23.429ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4192024-09-09T17:52:23.429ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4202024-09-09T17:52:23.429ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4212024-09-09T17:52:23.429ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4222024-09-09T17:52:23.429ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4232024-09-09T17:52:23.429ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
4242024-09-09T17:52:23.429ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4252024-09-09T17:52:23.429ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4262024-09-09T17:52:23.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4272024-09-09T17:52:23.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4282024-09-09T17:52:23.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4292024-09-09T17:52:23.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4302024-09-09T17:52:23.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4312024-09-09T17:52:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4322024-09-09T17:52:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4332024-09-09T17:52:23.431ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4342024-09-09T17:52:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4352024-09-09T17:52:23.431ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4362024-09-09T17:52:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4372024-09-09T17:52:23.432ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4382024-09-09T17:52:23.432ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("07c1bbdd-f080-4837-9528-41234be47bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 33665, tv_nsec: 39928315 } })
4392024-09-09T17:52:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4402024-09-09T17:52:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4412024-09-09T17:52:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4422024-09-09T17:52:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
4432024-09-09T17:52:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4442024-09-09T17:52:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4452024-09-09T17:52:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4462024-09-09T17:52:23.434ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("21f5073c-362d-497d-ae9e-f6ab85374703.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("42b0964a-b1a3-443e-b006-c18e1ad8d003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 33665, tv_nsec: 42770312 } })
4472024-09-09T17:52:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4482024-09-09T17:52:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4492024-09-09T17:52:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4502024-09-09T17:52:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4512024-09-09T17:52:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4522024-09-09T17:52:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4532024-09-09T17:52:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4542024-09-09T17:52:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4552024-09-09T17:52:23.435ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
4562024-09-09T17:52:23.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4572024-09-09T17:52:23.435ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4582024-09-09T17:52:23.435ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4592024-09-09T17:52:23.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4602024-09-09T17:52:23.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
4612024-09-09T17:52:23.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4622024-09-09T17:52:23.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4632024-09-09T17:52:23.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4642024-09-09T17:52:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4652024-09-09T17:52:23.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4662024-09-09T17:52:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4672024-09-09T17:52:23.440ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4682024-09-09T17:52:23.442ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4692024-09-09T17:52:23.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4702024-09-09T17:52:23.442ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-09 17:42:23.425857184 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
4712024-09-09T17:52:23.442ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 16.931869ms iteration = 1 status = {"expiration":"2024-09-09T17:42:23.425857184Z","pruned":[]}
4722024-09-09T17:52:23.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
4732024-09-09T17:52:23.444ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4742024-09-09T17:52:23.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4752024-09-09T17:52:23.447ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4762024-09-09T17:52:23.447ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 22.12131ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4772024-09-09T17:52:23.447ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
4782024-09-09T17:52:23.447ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4792024-09-09T17:52:23.447ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 5.44\u{b5}s iteration = 2 status = {"error":"no config"}
4802024-09-09T17:52:23.452ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4812024-09-09T17:52:23.452ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 26.354214ms iteration = 1 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
4822024-09-09T17:52:23.452ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
4832024-09-09T17:52:23.452ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4842024-09-09T17:52:23.452ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 4.86\u{b5}s iteration = 2 status = {"error":"no config"}
4852024-09-09T17:52:23.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4862024-09-09T17:52:23.453ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33665, tv_nsec: 62621648 } })
4872024-09-09T17:52:23.456ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
4882024-09-09T17:52:23.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4892024-09-09T17:52:23.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4902024-09-09T17:52:23.458ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
4912024-09-09T17:52:23.476ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 48.997567ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
4922024-09-09T17:52:23.477ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33665, tv_nsec: 86011825 } })
4932024-09-09T17:52:23.479ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
4942024-09-09T17:52:23.480ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4952024-09-09T17:52:23.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4962024-09-09T17:52:23.485ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 59.531408ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4972024-09-09T17:52:23.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4982024-09-09T17:52:23.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4992024-09-09T17:52:23.495ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5002024-09-09T17:52:23.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5012024-09-09T17:52:23.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.045914ms iteration = 1 status = {"errors":[],"records_set_to_done":[]}
5022024-09-09T17:52:23.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5032024-09-09T17:52:23.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5042024-09-09T17:52:23.501ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5052024-09-09T17:52:23.502ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5062024-09-09T17:52:23.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5072024-09-09T17:52:23.504ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5082024-09-09T17:52:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5092024-09-09T17:52:23.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5102024-09-09T17:52:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5112024-09-09T17:52:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5122024-09-09T17:52:23.508ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5132024-09-09T17:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5142024-09-09T17:52:23.511ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5152024-09-09T17:52:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5162024-09-09T17:52:23.518ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5172024-09-09T17:52:23.518ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5182024-09-09T17:52:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5192024-09-09T17:52:23.521ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5202024-09-09T17:52:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5212024-09-09T17:52:23.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5222024-09-09T17:52:23.523ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5232024-09-09T17:52:23.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5242024-09-09T17:52:23.524ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5252024-09-09T17:52:23.524ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5262024-09-09T17:52:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5272024-09-09T17:52:23.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5282024-09-09T17:52:23.527ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5292024-09-09T17:52:23.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5302024-09-09T17:52:23.530ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
5312024-09-09T17:52:23.530ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 103.628087ms iteration = 1 status = {"error":"rack not yet initialized: 1068bc7e-e3ab-44f6-b097-299854b0081f"}
5322024-09-09T17:52:23.530ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
5332024-09-09T17:52:23.530ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.938949ms iteration = 1 status = {"error":"inventory collection is None"}
5342024-09-09T17:52:23.531ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5352024-09-09T17:52:23.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5362024-09-09T17:52:23.532ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
5372024-09-09T17:52:23.532ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5382024-09-09T17:52:23.532ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f8502463-204c-4359-819f-9c9979e04ec5", "content-length": "26", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
5392024-09-09T17:52:23.532ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5402024-09-09T17:52:23.534ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5412024-09-09T17:52:23.534ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5422024-09-09T17:52:23.534ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 107.392149ms iteration = 1 status = {}
5432024-09-09T17:52:23.537ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
5442024-09-09T17:52:23.537ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 111.238571ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
5452024-09-09T17:52:23.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5462024-09-09T17:52:23.538ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5472024-09-09T17:52:23.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5482024-09-09T17:52:23.540ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5492024-09-09T17:52:23.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5502024-09-09T17:52:23.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5512024-09-09T17:52:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5522024-09-09T17:52:23.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5532024-09-09T17:52:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5542024-09-09T17:52:23.556ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 129.67985ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
5552024-09-09T17:52:23.556ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5562024-09-09T17:52:23.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5572024-09-09T17:52:23.557ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5582024-09-09T17:52:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5592024-09-09T17:52:23.570ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
5602024-09-09T17:52:23.570ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
5612024-09-09T17:52:23.570ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 143.846213ms iteration = 1 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
5622024-09-09T17:52:23.571ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
5632024-09-09T17:52:23.572ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
5642024-09-09T17:52:23.572ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 144.917859ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
5652024-09-09T17:52:23.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5662024-09-09T17:52:23.574ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
5672024-09-09T17:52:23.574ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
5682024-09-09T17:52:23.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5692024-09-09T17:52:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5702024-09-09T17:52:23.576ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
5712024-09-09T17:52:23.576ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5722024-09-09T17:52:23.576ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4d8b869c-6a39-4a14-bdd9-1273be7f2378", "content-length": "26", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
5732024-09-09T17:52:23.576ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5742024-09-09T17:52:23.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5752024-09-09T17:52:23.578ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5762024-09-09T17:52:23.594ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5772024-09-09T17:52:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5782024-09-09T17:52:23.596ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
5792024-09-09T17:52:23.596ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 169.656864ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
5802024-09-09T17:52:23.599ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
5812024-09-09T17:52:23.599ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 173.913588ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
5822024-09-09T17:52:23.600ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
5832024-09-09T17:52:23.600ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 174.739453ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
5842024-09-09T17:52:23.626ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 199.368748ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5852024-09-09T17:52:23.626ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5862024-09-09T17:52:23.628ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5872024-09-09T17:52:23.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5882024-09-09T17:52:23.629ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5892024-09-09T17:52:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5902024-09-09T17:52:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5912024-09-09T17:52:23.630ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5922024-09-09T17:52:23.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5932024-09-09T17:52:23.631ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
5942024-09-09T17:52:23.631ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
5952024-09-09T17:52:23.631ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 204.981392ms iteration = 1 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
5962024-09-09T17:52:23.632ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
5972024-09-09T17:52:23.633ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33665, tv_nsec: 242303921 } })
5982024-09-09T17:52:23.640ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
5992024-09-09T17:52:23.648ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a1ce526c-3390-48fc-866d-8a98fd950340", "content-length": "1", "date": "Mon, 09 Sep 2024 17:52:22 GMT"} })
6002024-09-09T17:52:23.650ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6012024-09-09T17:52:23.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6022024-09-09T17:52:23.651ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6032024-09-09T17:52:23.651ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 225.777903ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
6042024-09-09T17:52:23.660ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 234.709975ms iteration = 1 status = {}
6052024-09-09T17:52:23.661ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 235.015337ms iteration = 1 status = {}
6062024-09-09T17:52:23.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 235.816052ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6072024-09-09T17:52:23.666ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 240.468739ms iteration = 1 status = null
6082024-09-09T17:52:23.667ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6092024-09-09T17:52:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6102024-09-09T17:52:23.669ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6112024-09-09T17:52:23.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6122024-09-09T17:52:23.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 244.979265ms iteration = 1 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
6132024-09-09T17:52:23.672ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6142024-09-09T17:52:23.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6152024-09-09T17:52:23.674ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6162024-09-09T17:52:23.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6172024-09-09T17:52:23.675ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6182024-09-09T17:52:23.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6192024-09-09T17:52:23.677ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6202024-09-09T17:52:23.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6212024-09-09T17:52:23.678ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6222024-09-09T17:52:23.679ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 252.308399ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6232024-09-09T17:52:23.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6242024-09-09T17:52:23.682ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6252024-09-09T17:52:23.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6262024-09-09T17:52:23.683ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6272024-09-09T17:52:23.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6282024-09-09T17:52:23.685ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6292024-09-09T17:52:23.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6302024-09-09T17:52:23.687ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6312024-09-09T17:52:23.687ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6322024-09-09T17:52:23.687ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6332024-09-09T17:52:23.688ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6342024-09-09T17:52:23.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6352024-09-09T17:52:23.688ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/ignition", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7c9d2ae5-ebdf-4fce-9441-cbfe6f3006ab", "content-length": "476", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6362024-09-09T17:52:23.688ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6372024-09-09T17:52:23.689ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1e3d8565-8920-4c8e-b42f-c4df328deab3", "content-length": "734", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6382024-09-09T17:52:23.689ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6392024-09-09T17:52:23.689ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "57e670d1-92cd-48b9-a3fb-f3a312f2cafa", "content-length": "86", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6402024-09-09T17:52:23.689ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6412024-09-09T17:52:23.689ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b933dc4d-e775-4cf7-ac2b-00f0e49274bd", "content-length": "86", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6422024-09-09T17:52:23.689ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6432024-09-09T17:52:23.690ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "217e18cb-f9b7-4ae1-bc4e-4e553328ce36", "content-length": "80", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6442024-09-09T17:52:23.690ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6452024-09-09T17:52:23.690ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4e3ad425-b7a5-404c-a38b-5314c19b99a6", "content-length": "80", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6462024-09-09T17:52:23.690ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6472024-09-09T17:52:23.692ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "19a62c94-e2c4-4038-a3be-53570890d755", "content-length": "88", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6482024-09-09T17:52:23.692ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6492024-09-09T17:52:23.692ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e96bf984-5c6f-4971-977f-6282ed1bcd1d", "content-length": "88", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6502024-09-09T17:52:23.692ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6512024-09-09T17:52:23.694ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6522024-09-09T17:52:23.694ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 267.786919ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6532024-09-09T17:52:23.695ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "631131a3-0df7-45ea-99a9-85a176d3dddf", "content-length": "702", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6542024-09-09T17:52:23.695ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6552024-09-09T17:52:23.700ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fe9652a8-6b52-40d0-8dd6-c4fc200398d8", "content-length": "727", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6562024-09-09T17:52:23.700ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6572024-09-09T17:52:23.701ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6582024-09-09T17:52:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6592024-09-09T17:52:23.701ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "46640f34-d226-43ec-9197-686986b33c15", "content-length": "729", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6602024-09-09T17:52:23.701ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6612024-09-09T17:52:23.702ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8d4bc3d3-2344-48cc-b6b3-c5e6968000a6", "content-length": "728", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6622024-09-09T17:52:23.702ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
6632024-09-09T17:52:23.702ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c926f4e3-13dd-4eb0-9c70-cf44378c50ea", "content-length": "722", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6642024-09-09T17:52:23.702ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
6652024-09-09T17:52:23.702ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5e11a8f4-102a-405f-ac47-f9b7477462ad", "content-length": "84", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6662024-09-09T17:52:23.702ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
6672024-09-09T17:52:23.704ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3897b310-28ef-415c-99ba-088b7cf88218", "content-length": "84", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6682024-09-09T17:52:23.704ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
6692024-09-09T17:52:23.704ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6702024-09-09T17:52:23.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6712024-09-09T17:52:23.704ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e281181d-d3fe-4c2f-b9df-b2f7e2a3923c", "content-length": "82", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6722024-09-09T17:52:23.704ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
6732024-09-09T17:52:23.704ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3df36f11-5688-4b07-b890-47f65707d49c", "content-length": "82", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6742024-09-09T17:52:23.704ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
6752024-09-09T17:52:23.705ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f91e1bc6-dcd3-4665-928e-39b582a683e7", "content-length": "91", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6762024-09-09T17:52:23.705ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
6772024-09-09T17:52:23.705ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6782024-09-09T17:52:23.706ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "755c4cad-e6f2-47f8-bfd5-daae4401b51d", "content-length": "91", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6792024-09-09T17:52:23.706ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
6802024-09-09T17:52:23.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6812024-09-09T17:52:23.706ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2e973e19-4c28-4639-86ea-092c9862fba4", "content-length": "702", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6822024-09-09T17:52:23.706ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6832024-09-09T17:52:23.707ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0262d41e-c57a-413c-a73f-5ce314d38af2", "content-length": "727", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6842024-09-09T17:52:23.707ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6852024-09-09T17:52:23.707ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ab539959-bf88-4e86-839b-6141fdde2027", "content-length": "729", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6862024-09-09T17:52:23.707ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6872024-09-09T17:52:23.707ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a6b187bc-c90b-468f-88b3-31a4af8b03b4", "content-length": "728", "date": "Mon, 09 Sep 2024 17:52:23 GMT"} })
6882024-09-09T17:52:23.707ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6892024-09-09T17:52:23.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6902024-09-09T17:52:23.708ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6912024-09-09T17:52:23.709ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6922024-09-09T17:52:23.711ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
6932024-09-09T17:52:23.711ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6942024-09-09T17:52:23.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6952024-09-09T17:52:23.712ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
6962024-09-09T17:52:23.712ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6972024-09-09T17:52:23.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6982024-09-09T17:52:23.713ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6992024-09-09T17:52:23.713ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7002024-09-09T17:52:23.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7012024-09-09T17:52:23.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7022024-09-09T17:52:23.715ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7032024-09-09T17:52:23.715ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7042024-09-09T17:52:23.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7052024-09-09T17:52:23.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7062024-09-09T17:52:23.717ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7072024-09-09T17:52:23.720ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7082024-09-09T17:52:23.720ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7092024-09-09T17:52:23.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7102024-09-09T17:52:23.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7112024-09-09T17:52:23.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7122024-09-09T17:52:23.751ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7132024-09-09T17:52:23.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7142024-09-09T17:52:23.753ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7152024-09-09T17:52:23.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7162024-09-09T17:52:23.756ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7172024-09-09T17:52:23.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7182024-09-09T17:52:23.758ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7192024-09-09T17:52:23.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7202024-09-09T17:52:23.760ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7212024-09-09T17:52:23.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7222024-09-09T17:52:23.762ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7232024-09-09T17:52:23.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7242024-09-09T17:52:23.765ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7252024-09-09T17:52:23.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7262024-09-09T17:52:23.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7272024-09-09T17:52:23.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7282024-09-09T17:52:23.812ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7292024-09-09T17:52:23.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7302024-09-09T17:52:23.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7312024-09-09T17:52:23.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7322024-09-09T17:52:23.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7332024-09-09T17:52:23.823ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7342024-09-09T17:52:23.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7352024-09-09T17:52:23.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7362024-09-09T17:52:23.830ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 403.324263ms iteration = 1 status = {}
7372024-09-09T17:52:23.830ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7382024-09-09T17:52:23.836ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7392024-09-09T17:52:23.836ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7402024-09-09T17:52:23.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7412024-09-09T17:52:23.838ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
7422024-09-09T17:52:23.838ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7432024-09-09T17:52:23.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7442024-09-09T17:52:23.840ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7452024-09-09T17:52:23.840ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7462024-09-09T17:52:23.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7472024-09-09T17:52:23.842ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7482024-09-09T17:52:23.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7492024-09-09T17:52:23.842ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7502024-09-09T17:52:23.844ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7512024-09-09T17:52:23.848ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7522024-09-09T17:52:23.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7532024-09-09T17:52:23.849ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7542024-09-09T17:52:23.849ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7552024-09-09T17:52:23.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7562024-09-09T17:52:23.872ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
7572024-09-09T17:52:23.872ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7582024-09-09T17:52:23.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7592024-09-09T17:52:23.874ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7602024-09-09T17:52:23.875ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
7612024-09-09T17:52:23.876ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7622024-09-09T17:52:23.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7632024-09-09T17:52:23.894ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
7642024-09-09T17:52:23.894ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
7652024-09-09T17:52:23.894ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
7662024-09-09T17:52:24.055ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
7672024-09-09T17:52:24.055ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
7682024-09-09T17:52:24.055ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
7692024-09-09T17:52:24.055ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 628.536762ms
7702024-09-09T17:52:24.055ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 628.566683ms iteration = 1 status = {}
7712024-09-09T17:52:24.242ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 87fbfdfd-bfc3-4804-8221-9e0fb079a831 file = nexus/db-queries/src/db/datastore/inventory.rs:893
7722024-09-09T17:52:24.243ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 87fbfdfd-bfc3-4804-8221-9e0fb079a831 time_started = 2024-09-09 17:52:23.686696 UTC
7732024-09-09T17:52:24.243ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 816.780906ms iteration = 1 status = {"collection_id":"87fbfdfd-bfc3-4804-8221-9e0fb079a831","time_done":"2024-09-09 17:52:23.838871 UTC","time_started":"2024-09-09 17:52:23.686696 UTC"}
7742024-09-09T17:52:24.243ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
7752024-09-09T17:52:24.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7762024-09-09T17:52:24.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7772024-09-09T17:52:24.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7782024-09-09T17:52:24.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7792024-09-09T17:52:24.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7802024-09-09T17:52:24.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7812024-09-09T17:52:24.251ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
7822024-09-09T17:52:24.251ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 7.646305ms iteration = 2 status = {"error":"rack not yet initialized: 1068bc7e-e3ab-44f6-b097-299854b0081f"}
7832024-09-09T17:52:25.107ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7842024-09-09T17:52:25.107ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7852024-09-09T17:52:25.109ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7862024-09-09T17:52:25.109ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7872024-09-09T17:52:25.110ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7882024-09-09T17:52:25.113ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(())
7892024-09-09T17:52:25.113ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1068bc7e-e3ab-44f6-b097-299854b0081f, time_created: 2024-09-09T17:52:23.630723Z, time_modified: 2024-09-09T17:52:23.630723Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:765
7902024-09-09T17:52:26.883ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:51327
7912024-09-09T17:52:26.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51327 req_id = f1c0f62c-c58d-4c01-8321-11d481a6b7d6 roles = RoleSet { roles: {} } uri = /metrics/producers
7922024-09-09T17:52:26.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51327 req_id = f1c0f62c-c58d-4c01-8321-11d481a6b7d6 resource = Database result = Ok(()) uri = /metrics/producers
7932024-09-09T17:52:26.930ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
7942024-09-09T17:52:26.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51327 req_id = f1c0f62c-c58d-4c01-8321-11d481a6b7d6 roles = RoleSet { roles: {} } uri = /metrics/producers
7952024-09-09T17:52:26.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51327 req_id = f1c0f62c-c58d-4c01-8321-11d481a6b7d6 resource = Database result = Ok(()) uri = /metrics/producers
7962024-09-09T17:52:26.964ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
7972024-09-09T17:52:26.972ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2cc7e8ca-652c-411e-99d6-1b65447a16ea", "date": "Mon, 09 Sep 2024 17:52:26 GMT"} })
7982024-09-09T17:52:26.972ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 11e4ca7f-2a45-4733-9ef1-4614c608a84b
7992024-09-09T17:52:26.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 86321 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51327 req_id = f1c0f62c-c58d-4c01-8321-11d481a6b7d6 response_code = 201 uri = /metrics/producers
8002024-09-09T17:52:27.113ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8012024-09-09T17:52:27.113ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8022024-09-09T17:52:27.115ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8032024-09-09T17:52:27.115ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8042024-09-09T17:52:27.117ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8052024-09-09T17:52:27.119ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(())
8062024-09-09T17:52:27.119ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1068bc7e-e3ab-44f6-b097-299854b0081f, time_created: 2024-09-09T17:52:23.630723Z, time_modified: 2024-09-09T17:52:23.630723Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:765
8072024-09-09T17:52:29.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8082024-09-09T17:52:29.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8092024-09-09T17:52:29.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8102024-09-09T17:52:29.031ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8112024-09-09T17:52:29.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8122024-09-09T17:52:29.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8132024-09-09T17:52:29.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8142024-09-09T17:52:29.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8152024-09-09T17:52:29.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8162024-09-09T17:52:29.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8172024-09-09T17:52:29.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8182024-09-09T17:52:29.060ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8192024-09-09T17:52:29.060ZDEBGnexus (dropshot_internal): updating rack subnet for rack 1068bc7e-e3ab-44f6-b097-299854b0081f to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8202024-09-09T17:52:29.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8212024-09-09T17:52:29.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8222024-09-09T17:52:29.066ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8232024-09-09T17:52:29.098ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8242024-09-09T17:52:29.099ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/ports", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "92945ad6-9d1f-410c-831b-116d26364e87", "content-length": "24", "date": "Mon, 09 Sep 2024 17:52:28 GMT"} }) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8252024-09-09T17:52:29.101ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8262024-09-09T17:52:29.101ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8272024-09-09T17:52:29.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8282024-09-09T17:52:29.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8292024-09-09T17:52:29.121ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8302024-09-09T17:52:29.121ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8312024-09-09T17:52:29.123ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8322024-09-09T17:52:29.123ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8332024-09-09T17:52:29.124ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8342024-09-09T17:52:29.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8352024-09-09T17:52:29.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8362024-09-09T17:52:29.124ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8372024-09-09T17:52:29.127ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(())
8382024-09-09T17:52:29.127ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1068bc7e-e3ab-44f6-b097-299854b0081f, time_created: 2024-09-09T17:52:23.630723Z, time_modified: 2024-09-09T17:52:23.630723Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
8392024-09-09T17:52:29.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8402024-09-09T17:52:29.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8412024-09-09T17:52:29.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8422024-09-09T17:52:29.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8432024-09-09T17:52:29.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8442024-09-09T17:52:29.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8452024-09-09T17:52:29.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8462024-09-09T17:52:29.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8472024-09-09T17:52:29.271ZERROnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound file = nexus/db-queries/src/db/datastore/switch_port.rs:890 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8482024-09-09T17:52:29.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8492024-09-09T17:52:29.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8502024-09-09T17:52:29.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8512024-09-09T17:52:29.279ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8522024-09-09T17:52:29.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8532024-09-09T17:52:29.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8542024-09-09T17:52:29.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8552024-09-09T17:52:29.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8562024-09-09T17:52:29.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8572024-09-09T17:52:29.285ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = IpPool { parent: Fleet, key: 620fbe0f-2a52-45bb-9dd1-df1ce8f85402, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8582024-09-09T17:52:29.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8592024-09-09T17:52:29.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8602024-09-09T17:52:29.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8612024-09-09T17:52:29.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8622024-09-09T17:52:29.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8632024-09-09T17:52:29.289ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = IpPool { parent: Fleet, key: 620fbe0f-2a52-45bb-9dd1-df1ce8f85402, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8642024-09-09T17:52:29.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8652024-09-09T17:52:29.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8662024-09-09T17:52:29.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8672024-09-09T17:52:29.320ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = BlueprintConfig result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8682024-09-09T17:52:29.409ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = c5ff7180-161c-42a8-859a-c0943c5fd89b file = nexus/db-queries/src/db/datastore/deployment.rs:266 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8692024-09-09T17:52:29.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8702024-09-09T17:52:29.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8712024-09-09T17:52:29.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8722024-09-09T17:52:29.412ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = BlueprintConfig result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8732024-09-09T17:52:29.428ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8742024-09-09T17:52:29.428ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8752024-09-09T17:52:29.428ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8762024-09-09T17:52:29.428ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8772024-09-09T17:52:29.428ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8782024-09-09T17:52:29.428ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8792024-09-09T17:52:29.428ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8802024-09-09T17:52:29.428ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8812024-09-09T17:52:29.512ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8822024-09-09T17:52:29.533ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8832024-09-09T17:52:29.558ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8842024-09-09T17:52:29.583ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8852024-09-09T17:52:29.605ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8862024-09-09T17:52:29.605ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8872024-09-09T17:52:29.605ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8882024-09-09T17:52:29.605ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8892024-09-09T17:52:29.605ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8902024-09-09T17:52:29.605ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8912024-09-09T17:52:29.605ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8922024-09-09T17:52:29.605ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8932024-09-09T17:52:29.605ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8942024-09-09T17:52:29.605ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8952024-09-09T17:52:29.605ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8962024-09-09T17:52:29.605ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8972024-09-09T17:52:29.605ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8982024-09-09T17:52:29.605ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
8992024-09-09T17:52:29.605ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9002024-09-09T17:52:29.649ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9012024-09-09T17:52:29.649ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9022024-09-09T17:52:29.649ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 99445748-3f8a-47eb-b03d-540bb23b7924, time_created: 2024-09-09T17:52:29.031059853Z, time_modified: 2024-09-09T17:52:29.031059853Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9032024-09-09T17:52:29.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9042024-09-09T17:52:29.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9052024-09-09T17:52:29.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9062024-09-09T17:52:29.653ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9072024-09-09T17:52:29.671ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9082024-09-09T17:52:29.675ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "61e07fcc-45b4-4b25-ae0d-e78eee62eb60" error_message_internal = not found: sled with id "61e07fcc-45b4-4b25-ae0d-e78eee62eb60" file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 648397 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = c5d09c0d-7435-4394-b97e-9d4c49d8ef7e response_code = 404 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9092024-09-09T17:52:30.116ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:46249
9102024-09-09T17:52:30.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46249 req_id = 60328903-2351-40ec-a1e2-78966f60b00e roles = RoleSet { roles: {} } uri = /metrics/producers
9112024-09-09T17:52:30.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46249 req_id = 60328903-2351-40ec-a1e2-78966f60b00e resource = Database result = Ok(()) uri = /metrics/producers
9122024-09-09T17:52:30.155ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
9132024-09-09T17:52:30.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46249 req_id = 60328903-2351-40ec-a1e2-78966f60b00e roles = RoleSet { roles: {} } uri = /metrics/producers
9142024-09-09T17:52:30.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46249 req_id = 60328903-2351-40ec-a1e2-78966f60b00e resource = Database result = Ok(()) uri = /metrics/producers
9152024-09-09T17:52:30.165ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
9162024-09-09T17:52:30.166ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "073a0ef1-9bbb-4749-acf8-9498ade5c21c", "date": "Mon, 09 Sep 2024 17:52:30 GMT"} })
9172024-09-09T17:52:30.166ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = fdca555f-3b9a-4118-ba07-7428edbb0dfc
9182024-09-09T17:52:30.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 46718 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46249 req_id = 60328903-2351-40ec-a1e2-78966f60b00e response_code = 201 uri = /metrics/producers
9192024-09-09T17:52:31.128ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9202024-09-09T17:52:31.128ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9212024-09-09T17:52:31.130ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9222024-09-09T17:52:31.130ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9232024-09-09T17:52:31.131ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9242024-09-09T17:52:31.134ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(())
9252024-09-09T17:52:31.134ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1068bc7e-e3ab-44f6-b097-299854b0081f, time_created: 2024-09-09T17:52:23.630723Z, time_modified: 2024-09-09T17:52:23.630723Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
9262024-09-09T17:52:31.680ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:43176
9272024-09-09T17:52:31.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43176 req_id = 8da1b842-9310-4cad-8511-54a4d33cbda5 roles = RoleSet { roles: {} } uri = /metrics/producers
9282024-09-09T17:52:31.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43176 req_id = 8da1b842-9310-4cad-8511-54a4d33cbda5 resource = Database result = Ok(()) uri = /metrics/producers
9292024-09-09T17:52:31.714ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
9302024-09-09T17:52:31.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43176 req_id = 8da1b842-9310-4cad-8511-54a4d33cbda5 roles = RoleSet { roles: {} } uri = /metrics/producers
9312024-09-09T17:52:31.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43176 req_id = 8da1b842-9310-4cad-8511-54a4d33cbda5 resource = Database result = Ok(()) uri = /metrics/producers
9322024-09-09T17:52:31.755ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
9332024-09-09T17:52:31.756ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8ce94c24-d615-433b-8010-0bc79621706f", "date": "Mon, 09 Sep 2024 17:52:31 GMT"} })
9342024-09-09T17:52:31.756ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60
9352024-09-09T17:52:31.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 75866 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43176 req_id = 8da1b842-9310-4cad-8511-54a4d33cbda5 response_code = 201 uri = /metrics/producers
9362024-09-09T17:52:33.134ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9372024-09-09T17:52:33.135ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9382024-09-09T17:52:33.136ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9392024-09-09T17:52:33.136ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9402024-09-09T17:52:33.138ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9412024-09-09T17:52:33.140ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(())
9422024-09-09T17:52:33.140ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1068bc7e-e3ab-44f6-b097-299854b0081f, time_created: 2024-09-09T17:52:23.630723Z, time_modified: 2024-09-09T17:52:23.630723Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
9432024-09-09T17:52:33.425ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
9442024-09-09T17:52:33.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9452024-09-09T17:52:33.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9462024-09-09T17:52:33.426ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
9472024-09-09T17:52:33.426ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9482024-09-09T17:52:33.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9492024-09-09T17:52:33.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9502024-09-09T17:52:33.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9512024-09-09T17:52:33.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9522024-09-09T17:52:33.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9532024-09-09T17:52:33.432ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
9542024-09-09T17:52:33.432ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 6.249567ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
9552024-09-09T17:52:33.452ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9562024-09-09T17:52:33.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9572024-09-09T17:52:33.486ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.676219ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9582024-09-09T17:52:33.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9592024-09-09T17:52:33.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9602024-09-09T17:52:33.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9612024-09-09T17:52:33.615ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9622024-09-09T17:52:33.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9632024-09-09T17:52:33.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9642024-09-09T17:52:33.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9652024-09-09T17:52:33.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9662024-09-09T17:52:33.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9672024-09-09T17:52:33.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9682024-09-09T17:52:33.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9692024-09-09T17:52:33.646ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9702024-09-09T17:52:33.646ZDEBGnexus (dropshot_internal): updating rack subnet for rack 1068bc7e-e3ab-44f6-b097-299854b0081f to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9712024-09-09T17:52:33.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9722024-09-09T17:52:33.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9732024-09-09T17:52:33.650ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9742024-09-09T17:52:33.681ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9752024-09-09T17:52:33.681ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/ports", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "34c7f91e-8a47-4df6-8b61-c5839c24b01d", "content-length": "24", "date": "Mon, 09 Sep 2024 17:52:33 GMT"} }) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9762024-09-09T17:52:33.681ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9772024-09-09T17:52:33.681ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9782024-09-09T17:52:33.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9792024-09-09T17:52:33.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9802024-09-09T17:52:33.702ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9812024-09-09T17:52:33.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9822024-09-09T17:52:33.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9832024-09-09T17:52:33.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9842024-09-09T17:52:33.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9852024-09-09T17:52:33.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9862024-09-09T17:52:33.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9872024-09-09T17:52:33.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9882024-09-09T17:52:33.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9892024-09-09T17:52:33.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9902024-09-09T17:52:33.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9912024-09-09T17:52:33.738ZERROnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound file = nexus/db-queries/src/db/datastore/switch_port.rs:890 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9922024-09-09T17:52:33.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9932024-09-09T17:52:33.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9942024-09-09T17:52:33.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9952024-09-09T17:52:33.742ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9962024-09-09T17:52:33.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9972024-09-09T17:52:33.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9982024-09-09T17:52:33.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
9992024-09-09T17:52:33.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10002024-09-09T17:52:33.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10012024-09-09T17:52:33.755ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = IpPool { parent: Fleet, key: 620fbe0f-2a52-45bb-9dd1-df1ce8f85402, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10022024-09-09T17:52:33.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10032024-09-09T17:52:33.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10042024-09-09T17:52:33.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10052024-09-09T17:52:33.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10062024-09-09T17:52:33.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10072024-09-09T17:52:33.760ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = IpPool { parent: Fleet, key: 620fbe0f-2a52-45bb-9dd1-df1ce8f85402, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10082024-09-09T17:52:33.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10092024-09-09T17:52:33.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10102024-09-09T17:52:33.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10112024-09-09T17:52:33.786ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = BlueprintConfig result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10122024-09-09T17:52:33.887ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = c5ff7180-161c-42a8-859a-c0943c5fd89b file = nexus/db-queries/src/db/datastore/deployment.rs:266 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10132024-09-09T17:52:33.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10142024-09-09T17:52:33.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10152024-09-09T17:52:33.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10162024-09-09T17:52:33.891ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = BlueprintConfig result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10172024-09-09T17:52:33.896ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10182024-09-09T17:52:33.896ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10192024-09-09T17:52:33.896ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10202024-09-09T17:52:33.896ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10212024-09-09T17:52:33.896ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10222024-09-09T17:52:33.896ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10232024-09-09T17:52:33.896ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10242024-09-09T17:52:33.896ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10252024-09-09T17:52:33.975ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10262024-09-09T17:52:34.002ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10272024-09-09T17:52:34.024ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10282024-09-09T17:52:34.045ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10292024-09-09T17:52:34.065ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10302024-09-09T17:52:34.065ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10312024-09-09T17:52:34.065ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10322024-09-09T17:52:34.065ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10332024-09-09T17:52:34.065ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10342024-09-09T17:52:34.065ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10352024-09-09T17:52:34.065ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10362024-09-09T17:52:34.065ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10372024-09-09T17:52:34.065ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10382024-09-09T17:52:34.065ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10392024-09-09T17:52:34.065ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10402024-09-09T17:52:34.065ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10412024-09-09T17:52:34.065ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10422024-09-09T17:52:34.065ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10432024-09-09T17:52:34.065ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10442024-09-09T17:52:34.093ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10452024-09-09T17:52:34.093ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10462024-09-09T17:52:34.093ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 99445748-3f8a-47eb-b03d-540bb23b7924, time_created: 2024-09-09T17:52:33.615914144Z, time_modified: 2024-09-09T17:52:33.615914144Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10472024-09-09T17:52:34.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10482024-09-09T17:52:34.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10492024-09-09T17:52:34.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10502024-09-09T17:52:34.097ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10512024-09-09T17:52:34.121ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10522024-09-09T17:52:34.124ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "61e07fcc-45b4-4b25-ae0d-e78eee62eb60" error_message_internal = not found: sled with id "61e07fcc-45b4-4b25-ae0d-e78eee62eb60" file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 512475 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 3762bf19-6e73-4127-ac27-2075056b81e9 response_code = 404 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
10532024-09-09T17:52:35.141ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10542024-09-09T17:52:35.141ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10552024-09-09T17:52:35.143ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10562024-09-09T17:52:35.143ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10572024-09-09T17:52:35.145ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10582024-09-09T17:52:35.147ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(())
10592024-09-09T17:52:35.147ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1068bc7e-e3ab-44f6-b097-299854b0081f, time_created: 2024-09-09T17:52:23.630723Z, time_modified: 2024-09-09T17:52:23.630723Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
10602024-09-09T17:52:37.148ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10612024-09-09T17:52:37.149ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10622024-09-09T17:52:37.150ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10632024-09-09T17:52:37.150ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10642024-09-09T17:52:37.152ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10652024-09-09T17:52:37.154ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(())
10662024-09-09T17:52:37.154ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1068bc7e-e3ab-44f6-b097-299854b0081f, time_created: 2024-09-09T17:52:23.630723Z, time_modified: 2024-09-09T17:52:23.630723Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
10672024-09-09T17:52:37.810ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:41455
10682024-09-09T17:52:37.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41455 req_id = 71c25001-d8d7-4460-b5cf-133ba3589ea7 roles = RoleSet { roles: {} } uri = /metrics/producers
10692024-09-09T17:52:37.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41455 req_id = 71c25001-d8d7-4460-b5cf-133ba3589ea7 resource = Database result = Ok(()) uri = /metrics/producers
10702024-09-09T17:52:37.843ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
10712024-09-09T17:52:37.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41455 req_id = 71c25001-d8d7-4460-b5cf-133ba3589ea7 roles = RoleSet { roles: {} } uri = /metrics/producers
10722024-09-09T17:52:37.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41455 req_id = 71c25001-d8d7-4460-b5cf-133ba3589ea7 resource = Database result = Ok(()) uri = /metrics/producers
10732024-09-09T17:52:37.851ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
10742024-09-09T17:52:37.851ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "627d99f6-cfc2-4426-a6d3-621c2f4545e0", "date": "Mon, 09 Sep 2024 17:52:37 GMT"} })
10752024-09-09T17:52:37.851ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = fd6a3800-ebfc-41fd-a922-894d8d51ff21
10762024-09-09T17:52:37.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 41423 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41455 req_id = 71c25001-d8d7-4460-b5cf-133ba3589ea7 response_code = 201 uri = /metrics/producers
10772024-09-09T17:52:39.155ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10782024-09-09T17:52:39.156ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10792024-09-09T17:52:39.158ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10802024-09-09T17:52:39.158ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10812024-09-09T17:52:39.159ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10822024-09-09T17:52:39.161ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(())
10832024-09-09T17:52:39.161ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1068bc7e-e3ab-44f6-b097-299854b0081f, time_created: 2024-09-09T17:52:23.630723Z, time_modified: 2024-09-09T17:52:23.630723Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
10842024-09-09T17:52:41.163ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10852024-09-09T17:52:41.163ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10862024-09-09T17:52:41.165ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10872024-09-09T17:52:41.165ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10882024-09-09T17:52:41.166ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10892024-09-09T17:52:41.169ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(())
10902024-09-09T17:52:41.169ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1068bc7e-e3ab-44f6-b097-299854b0081f, time_created: 2024-09-09T17:52:23.630723Z, time_modified: 2024-09-09T17:52:23.630723Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
10912024-09-09T17:52:43.170ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10922024-09-09T17:52:43.170ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10932024-09-09T17:52:43.172ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10942024-09-09T17:52:43.172ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10952024-09-09T17:52:43.174ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10962024-09-09T17:52:43.176ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(())
10972024-09-09T17:52:43.176ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1068bc7e-e3ab-44f6-b097-299854b0081f, time_created: 2024-09-09T17:52:23.630723Z, time_modified: 2024-09-09T17:52:23.630723Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
10982024-09-09T17:52:43.426ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
10992024-09-09T17:52:43.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11002024-09-09T17:52:43.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11012024-09-09T17:52:43.426ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
11022024-09-09T17:52:43.426ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11032024-09-09T17:52:43.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11042024-09-09T17:52:43.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11052024-09-09T17:52:43.430ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11062024-09-09T17:52:43.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11072024-09-09T17:52:43.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11082024-09-09T17:52:43.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11092024-09-09T17:52:43.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11102024-09-09T17:52:43.434ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
11112024-09-09T17:52:43.434ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 8.54563ms iteration = 3 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
11122024-09-09T17:52:43.459ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.801832ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11132024-09-09T17:52:43.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11142024-09-09T17:52:43.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11152024-09-09T17:52:43.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11162024-09-09T17:52:43.995ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11172024-09-09T17:52:43.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11182024-09-09T17:52:43.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11192024-09-09T17:52:43.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11202024-09-09T17:52:43.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11212024-09-09T17:52:43.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11222024-09-09T17:52:43.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11232024-09-09T17:52:44.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11242024-09-09T17:52:44.003ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11252024-09-09T17:52:44.003ZDEBGnexus (dropshot_internal): updating rack subnet for rack 1068bc7e-e3ab-44f6-b097-299854b0081f to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11262024-09-09T17:52:44.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11272024-09-09T17:52:44.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11282024-09-09T17:52:44.009ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11292024-09-09T17:52:44.040ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11302024-09-09T17:52:44.041ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/ports", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5d229447-442c-4476-ac82-e41eecbd2a87", "content-length": "24", "date": "Mon, 09 Sep 2024 17:52:43 GMT"} }) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11312024-09-09T17:52:44.041ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11322024-09-09T17:52:44.041ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11332024-09-09T17:52:44.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11342024-09-09T17:52:44.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11352024-09-09T17:52:44.052ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11362024-09-09T17:52:44.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11372024-09-09T17:52:44.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11382024-09-09T17:52:44.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11392024-09-09T17:52:44.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11402024-09-09T17:52:44.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11412024-09-09T17:52:44.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11422024-09-09T17:52:44.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11432024-09-09T17:52:44.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11442024-09-09T17:52:44.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11452024-09-09T17:52:44.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11462024-09-09T17:52:44.069ZERROnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound file = nexus/db-queries/src/db/datastore/switch_port.rs:890 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11472024-09-09T17:52:44.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11482024-09-09T17:52:44.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11492024-09-09T17:52:44.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11502024-09-09T17:52:44.073ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11512024-09-09T17:52:44.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11522024-09-09T17:52:44.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11532024-09-09T17:52:44.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11542024-09-09T17:52:44.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11552024-09-09T17:52:44.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11562024-09-09T17:52:44.079ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = IpPool { parent: Fleet, key: 620fbe0f-2a52-45bb-9dd1-df1ce8f85402, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11572024-09-09T17:52:44.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11582024-09-09T17:52:44.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11592024-09-09T17:52:44.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11602024-09-09T17:52:44.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11612024-09-09T17:52:44.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11622024-09-09T17:52:44.084ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = IpPool { parent: Fleet, key: 620fbe0f-2a52-45bb-9dd1-df1ce8f85402, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11632024-09-09T17:52:44.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11642024-09-09T17:52:44.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11652024-09-09T17:52:44.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11662024-09-09T17:52:44.092ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = BlueprintConfig result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11672024-09-09T17:52:44.100ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = c5ff7180-161c-42a8-859a-c0943c5fd89b file = nexus/db-queries/src/db/datastore/deployment.rs:266 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11682024-09-09T17:52:44.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11692024-09-09T17:52:44.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11702024-09-09T17:52:44.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11712024-09-09T17:52:44.104ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = BlueprintConfig result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11722024-09-09T17:52:44.107ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11732024-09-09T17:52:44.107ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11742024-09-09T17:52:44.107ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11752024-09-09T17:52:44.107ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11762024-09-09T17:52:44.107ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11772024-09-09T17:52:44.107ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11782024-09-09T17:52:44.107ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11792024-09-09T17:52:44.107ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11802024-09-09T17:52:44.136ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11812024-09-09T17:52:44.157ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11822024-09-09T17:52:44.177ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11832024-09-09T17:52:44.196ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11842024-09-09T17:52:44.219ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11852024-09-09T17:52:44.219ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11862024-09-09T17:52:44.219ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11872024-09-09T17:52:44.219ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11882024-09-09T17:52:44.219ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11892024-09-09T17:52:44.219ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11902024-09-09T17:52:44.219ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11912024-09-09T17:52:44.219ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11922024-09-09T17:52:44.219ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11932024-09-09T17:52:44.219ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11942024-09-09T17:52:44.219ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11952024-09-09T17:52:44.219ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11962024-09-09T17:52:44.219ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11972024-09-09T17:52:44.219ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11982024-09-09T17:52:44.219ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
11992024-09-09T17:52:44.244ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
12002024-09-09T17:52:44.244ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
12012024-09-09T17:52:44.244ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 99445748-3f8a-47eb-b03d-540bb23b7924, time_created: 2024-09-09T17:52:43.995623127Z, time_modified: 2024-09-09T17:52:43.995623127Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
12022024-09-09T17:52:44.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
12032024-09-09T17:52:44.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
12042024-09-09T17:52:44.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
12052024-09-09T17:52:44.248ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
12062024-09-09T17:52:44.251ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
12072024-09-09T17:52:44.255ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "61e07fcc-45b4-4b25-ae0d-e78eee62eb60" error_message_internal = not found: sled with id "61e07fcc-45b4-4b25-ae0d-e78eee62eb60" file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 263814 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = ce3454ed-b17f-4516-9246-53b32f21fc3a response_code = 404 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
12082024-09-09T17:52:45.177ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12092024-09-09T17:52:45.178ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12102024-09-09T17:52:45.179ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12112024-09-09T17:52:45.180ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12122024-09-09T17:52:45.182ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12132024-09-09T17:52:45.184ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(())
12142024-09-09T17:52:45.184ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1068bc7e-e3ab-44f6-b097-299854b0081f, time_created: 2024-09-09T17:52:23.630723Z, time_modified: 2024-09-09T17:52:23.630723Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
12152024-09-09T17:52:47.185ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12162024-09-09T17:52:47.186ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12172024-09-09T17:52:47.187ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12182024-09-09T17:52:47.187ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12192024-09-09T17:52:47.189ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12202024-09-09T17:52:47.192ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(())
12212024-09-09T17:52:47.192ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1068bc7e-e3ab-44f6-b097-299854b0081f, time_created: 2024-09-09T17:52:23.630723Z, time_modified: 2024-09-09T17:52:23.630723Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
12222024-09-09T17:52:49.192ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12232024-09-09T17:52:49.193ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12242024-09-09T17:52:49.194ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12252024-09-09T17:52:49.195ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12262024-09-09T17:52:49.196ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12272024-09-09T17:52:49.199ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(())
12282024-09-09T17:52:49.199ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1068bc7e-e3ab-44f6-b097-299854b0081f, time_created: 2024-09-09T17:52:23.630723Z, time_modified: 2024-09-09T17:52:23.630723Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
12292024-09-09T17:52:51.199ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12302024-09-09T17:52:51.200ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12312024-09-09T17:52:51.201ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12322024-09-09T17:52:51.202ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12332024-09-09T17:52:51.203ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12342024-09-09T17:52:51.205ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(())
12352024-09-09T17:52:51.205ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1068bc7e-e3ab-44f6-b097-299854b0081f, time_created: 2024-09-09T17:52:23.630723Z, time_modified: 2024-09-09T17:52:23.630723Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
12362024-09-09T17:52:53.206ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12372024-09-09T17:52:53.207ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12382024-09-09T17:52:53.208ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12392024-09-09T17:52:53.208ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12402024-09-09T17:52:53.210ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12412024-09-09T17:52:53.212ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(())
12422024-09-09T17:52:53.212ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 1068bc7e-e3ab-44f6-b097-299854b0081f, time_created: 2024-09-09T17:52:23.630723Z, time_modified: 2024-09-09T17:52:23.630723Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:765
12432024-09-09T17:52:53.425ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
12442024-09-09T17:52:53.425ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
12452024-09-09T17:52:53.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12462024-09-09T17:52:53.425ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
12472024-09-09T17:52:53.425ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
12482024-09-09T17:52:53.425ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12492024-09-09T17:52:53.425ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
12502024-09-09T17:52:53.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12512024-09-09T17:52:53.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12522024-09-09T17:52:53.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
12532024-09-09T17:52:53.426ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
12542024-09-09T17:52:53.426ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
12552024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
12562024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
12572024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12582024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12592024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
12602024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
12612024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12622024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12632024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
12642024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
12652024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12662024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
12672024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12682024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
12692024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12702024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
12712024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12722024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
12732024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Timeout
12742024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
12752024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12762024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
12772024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12782024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
12792024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12802024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
12812024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12822024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12832024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12842024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12852024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12862024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12872024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
12882024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12892024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12902024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12912024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12922024-09-09T17:52:53.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12932024-09-09T17:52:53.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12942024-09-09T17:52:53.428ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.815076ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
12952024-09-09T17:52:53.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12962024-09-09T17:52:53.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12972024-09-09T17:52:53.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12982024-09-09T17:52:53.432ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33695, tv_nsec: 40554622 } })
12992024-09-09T17:52:53.433ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
13002024-09-09T17:52:53.434ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13012024-09-09T17:52:53.435ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13022024-09-09T17:52:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13032024-09-09T17:52:53.436ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13042024-09-09T17:52:53.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
13052024-09-09T17:52:53.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13062024-09-09T17:52:53.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13072024-09-09T17:52:53.438ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33695, tv_nsec: 46759519 } })
13082024-09-09T17:52:53.438ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
13092024-09-09T17:52:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13102024-09-09T17:52:53.439ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13112024-09-09T17:52:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13122024-09-09T17:52:53.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13132024-09-09T17:52:53.442ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13142024-09-09T17:52:53.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13152024-09-09T17:52:53.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13162024-09-09T17:52:53.447ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
13172024-09-09T17:52:53.447ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.987569ms iteration = 4 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
13182024-09-09T17:52:53.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.088823ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13192024-09-09T17:52:53.451ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 24.019231ms iteration = 2 status = {}
13202024-09-09T17:52:53.451ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
13212024-09-09T17:52:53.451ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 24.062771ms iteration = 3 status = {"error":"rack not yet initialized: 1068bc7e-e3ab-44f6-b097-299854b0081f"}
13222024-09-09T17:52:53.473ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13232024-09-09T17:52:53.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
13242024-09-09T17:52:53.476ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13252024-09-09T17:52:53.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13262024-09-09T17:52:53.479ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13272024-09-09T17:52:53.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13282024-09-09T17:52:53.480ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13292024-09-09T17:52:53.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13302024-09-09T17:52:53.482ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.171043ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
13312024-09-09T17:52:53.487ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.182453ms iteration = 2 status = {"errors":[],"records_set_to_done":[]}
13322024-09-09T17:52:53.487ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
13332024-09-09T17:52:53.487ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13342024-09-09T17:52:53.487ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c6e7c2c5-fd97-4628-87f9-76d7302598bc", "content-length": "26", "date": "Mon, 09 Sep 2024 17:52:53 GMT"} })
13352024-09-09T17:52:53.487ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13362024-09-09T17:52:53.489ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13372024-09-09T17:52:53.492ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
13382024-09-09T17:52:53.492ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
13392024-09-09T17:52:53.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13402024-09-09T17:52:53.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13412024-09-09T17:52:53.494ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13422024-09-09T17:52:53.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13432024-09-09T17:52:53.496ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
13442024-09-09T17:52:53.496ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13452024-09-09T17:52:53.497ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13462024-09-09T17:52:53.497ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13472024-09-09T17:52:53.497ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f718052d-4fe4-4252-b624-381581675eb3", "content-length": "26", "date": "Mon, 09 Sep 2024 17:52:53 GMT"} })
13482024-09-09T17:52:53.497ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13492024-09-09T17:52:53.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13502024-09-09T17:52:53.498ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13512024-09-09T17:52:53.499ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13522024-09-09T17:52:53.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
13532024-09-09T17:52:53.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13542024-09-09T17:52:53.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13552024-09-09T17:52:53.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13562024-09-09T17:52:53.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13572024-09-09T17:52:53.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13582024-09-09T17:52:53.526ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.04853ms iteration = 2 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
13592024-09-09T17:52:53.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13602024-09-09T17:52:53.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13612024-09-09T17:52:53.538ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 111.855565ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
13622024-09-09T17:52:53.567ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 141.66735ms iteration = 2 status = {}
13632024-09-09T17:52:53.568ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13642024-09-09T17:52:53.568ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1cd4a63c-e35f-4ba6-85fb-6e669f066307", "content-length": "1", "date": "Mon, 09 Sep 2024 17:52:52 GMT"} })
13652024-09-09T17:52:53.569ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13662024-09-09T17:52:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13672024-09-09T17:52:53.570ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
13682024-09-09T17:52:53.570ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 143.180579ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
13692024-09-09T17:52:53.570ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
13702024-09-09T17:52:53.570ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
13712024-09-09T17:52:53.570ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 143.33102ms iteration = 2 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
13722024-09-09T17:52:53.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 149.926278ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
13732024-09-09T17:52:53.582ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 157.01732ms iteration = 2 status = null
13742024-09-09T17:52:53.591ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13752024-09-09T17:52:53.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13762024-09-09T17:52:53.607ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13772024-09-09T17:52:53.610ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a809104e-4bea-4165-b23a-dce4633a0251", "content-length": "312", "date": "Mon, 09 Sep 2024 17:52:53 GMT"} })
13782024-09-09T17:52:53.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13792024-09-09T17:52:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13802024-09-09T17:52:53.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13812024-09-09T17:52:53.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13822024-09-09T17:52:53.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13832024-09-09T17:52:53.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13842024-09-09T17:52:53.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13852024-09-09T17:52:53.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13862024-09-09T17:52:53.626ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13872024-09-09T17:52:53.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13882024-09-09T17:52:53.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13892024-09-09T17:52:53.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13902024-09-09T17:52:53.632ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13912024-09-09T17:52:53.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13922024-09-09T17:52:53.635ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13932024-09-09T17:52:53.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13942024-09-09T17:52:53.636ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13952024-09-09T17:52:53.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13962024-09-09T17:52:53.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13972024-09-09T17:52:53.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13982024-09-09T17:52:53.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13992024-09-09T17:52:53.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
14002024-09-09T17:52:53.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14012024-09-09T17:52:53.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14022024-09-09T17:52:53.644ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14032024-09-09T17:52:53.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14042024-09-09T17:52:53.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14052024-09-09T17:52:53.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14062024-09-09T17:52:53.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14072024-09-09T17:52:53.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14082024-09-09T17:52:53.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14092024-09-09T17:52:53.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14102024-09-09T17:52:53.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14112024-09-09T17:52:53.650ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
14122024-09-09T17:52:53.650ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14132024-09-09T17:52:53.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14142024-09-09T17:52:53.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14152024-09-09T17:52:53.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
14162024-09-09T17:52:53.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14172024-09-09T17:52:53.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14182024-09-09T17:52:53.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14192024-09-09T17:52:53.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14202024-09-09T17:52:53.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14212024-09-09T17:52:53.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14222024-09-09T17:52:53.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14232024-09-09T17:52:53.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14242024-09-09T17:52:53.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14252024-09-09T17:52:53.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14262024-09-09T17:52:53.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14272024-09-09T17:52:53.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14282024-09-09T17:52:53.661ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14292024-09-09T17:52:53.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14302024-09-09T17:52:53.662ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33695, tv_nsec: 271136203 } })
14312024-09-09T17:52:53.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14322024-09-09T17:52:53.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14332024-09-09T17:52:53.662ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1050
14342024-09-09T17:52:53.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14352024-09-09T17:52:53.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14362024-09-09T17:52:53.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14372024-09-09T17:52:53.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
14382024-09-09T17:52:53.668ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14392024-09-09T17:52:53.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14402024-09-09T17:52:53.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14412024-09-09T17:52:53.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14422024-09-09T17:52:53.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14432024-09-09T17:52:53.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14442024-09-09T17:52:53.672ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14452024-09-09T17:52:53.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14462024-09-09T17:52:53.673ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14472024-09-09T17:52:53.674ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14482024-09-09T17:52:53.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14492024-09-09T17:52:53.674ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14502024-09-09T17:52:53.674ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14512024-09-09T17:52:53.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14522024-09-09T17:52:53.676ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14532024-09-09T17:52:53.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14542024-09-09T17:52:53.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14552024-09-09T17:52:53.678ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14562024-09-09T17:52:53.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14572024-09-09T17:52:53.678ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14582024-09-09T17:52:53.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14592024-09-09T17:52:53.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14602024-09-09T17:52:53.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14612024-09-09T17:52:53.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14622024-09-09T17:52:53.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14632024-09-09T17:52:53.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
14642024-09-09T17:52:53.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14652024-09-09T17:52:53.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14662024-09-09T17:52:53.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14672024-09-09T17:52:53.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14682024-09-09T17:52:53.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14692024-09-09T17:52:53.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14702024-09-09T17:52:53.710ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
14712024-09-09T17:52:53.710ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14722024-09-09T17:52:53.710ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "97d6a967-844a-4d83-b2c0-405858dd374b", "content-length": "26", "date": "Mon, 09 Sep 2024 17:52:53 GMT"} })
14732024-09-09T17:52:53.710ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14742024-09-09T17:52:53.711ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14752024-09-09T17:52:53.742ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14762024-09-09T17:52:53.742ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9623d4ac-a627-43d8-87a8-af2425da9763", "content-length": "691", "date": "Mon, 09 Sep 2024 17:52:53 GMT"} })
14772024-09-09T17:52:53.742ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
14782024-09-09T17:52:53.742ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
14792024-09-09T17:52:53.742ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
14802024-09-09T17:52:53.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14812024-09-09T17:52:53.744ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 316.934167ms iteration = 2 status = {}
14822024-09-09T17:52:53.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14832024-09-09T17:52:53.745ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14842024-09-09T17:52:53.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14852024-09-09T17:52:53.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14862024-09-09T17:52:53.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14872024-09-09T17:52:53.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14882024-09-09T17:52:53.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14892024-09-09T17:52:53.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14902024-09-09T17:52:53.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ByName("boundary-ntp") } result = Ok(())
14912024-09-09T17:52:53.753ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14922024-09-09T17:52:53.753ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bdbe4b58-a7ae-420d-8ed1-583cc663e864", "date": "Mon, 09 Sep 2024 17:52:53 GMT"} })
14932024-09-09T17:52:53.754ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 327.302878ms iteration = 2 status = {}
14942024-09-09T17:52:53.757ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
14952024-09-09T17:52:53.758ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a21762f7-8fb6-40de-9e3b-ad9217a3b693", "content-length": "4", "date": "Mon, 09 Sep 2024 17:52:53 GMT"} })
14962024-09-09T17:52:53.759ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 332.78071ms iteration = 2 status = 1
14972024-09-09T17:52:53.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
14982024-09-09T17:52:53.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
14992024-09-09T17:52:53.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15002024-09-09T17:52:53.875ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15012024-09-09T17:52:53.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15022024-09-09T17:52:53.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15032024-09-09T17:52:53.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15042024-09-09T17:52:53.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15052024-09-09T17:52:53.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15062024-09-09T17:52:53.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15072024-09-09T17:52:53.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15082024-09-09T17:52:53.896ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15092024-09-09T17:52:53.896ZDEBGnexus (dropshot_internal): updating rack subnet for rack 1068bc7e-e3ab-44f6-b097-299854b0081f to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15102024-09-09T17:52:53.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15112024-09-09T17:52:53.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15122024-09-09T17:52:53.900ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15132024-09-09T17:52:53.931ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15142024-09-09T17:52:53.932ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/ports", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e0c37c9d-bed8-4e2d-8840-44f310bf1077", "content-length": "24", "date": "Mon, 09 Sep 2024 17:52:53 GMT"} }) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15152024-09-09T17:52:53.932ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15162024-09-09T17:52:53.932ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15172024-09-09T17:52:53.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15182024-09-09T17:52:53.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15192024-09-09T17:52:53.946ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15202024-09-09T17:52:53.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15212024-09-09T17:52:53.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15222024-09-09T17:52:53.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15232024-09-09T17:52:53.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15242024-09-09T17:52:53.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15252024-09-09T17:52:53.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15262024-09-09T17:52:53.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15272024-09-09T17:52:53.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15282024-09-09T17:52:53.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15292024-09-09T17:52:53.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15302024-09-09T17:52:53.959ZERROnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound file = nexus/db-queries/src/db/datastore/switch_port.rs:890 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15312024-09-09T17:52:53.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15322024-09-09T17:52:53.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15332024-09-09T17:52:53.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15342024-09-09T17:52:53.963ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15352024-09-09T17:52:53.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15362024-09-09T17:52:53.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15372024-09-09T17:52:53.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15382024-09-09T17:52:53.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15392024-09-09T17:52:53.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15402024-09-09T17:52:53.969ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = IpPool { parent: Fleet, key: 620fbe0f-2a52-45bb-9dd1-df1ce8f85402, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15412024-09-09T17:52:53.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15422024-09-09T17:52:53.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15432024-09-09T17:52:53.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15442024-09-09T17:52:53.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15452024-09-09T17:52:53.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15462024-09-09T17:52:53.973ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = IpPool { parent: Fleet, key: 620fbe0f-2a52-45bb-9dd1-df1ce8f85402, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15472024-09-09T17:52:53.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15482024-09-09T17:52:53.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15492024-09-09T17:52:53.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15502024-09-09T17:52:53.983ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = BlueprintConfig result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15512024-09-09T17:52:54.028ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = c5ff7180-161c-42a8-859a-c0943c5fd89b file = nexus/db-queries/src/db/datastore/deployment.rs:266 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15522024-09-09T17:52:54.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15532024-09-09T17:52:54.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15542024-09-09T17:52:54.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15552024-09-09T17:52:54.031ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = BlueprintConfig result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15562024-09-09T17:52:54.040ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15572024-09-09T17:52:54.040ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15582024-09-09T17:52:54.040ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15592024-09-09T17:52:54.040ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15602024-09-09T17:52:54.040ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15612024-09-09T17:52:54.040ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15622024-09-09T17:52:54.040ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15632024-09-09T17:52:54.040ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15642024-09-09T17:52:54.093ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15652024-09-09T17:52:54.121ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15662024-09-09T17:52:54.143ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15672024-09-09T17:52:54.164ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15682024-09-09T17:52:54.184ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15692024-09-09T17:52:54.184ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15702024-09-09T17:52:54.184ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15712024-09-09T17:52:54.184ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15722024-09-09T17:52:54.184ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15732024-09-09T17:52:54.184ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15742024-09-09T17:52:54.184ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15752024-09-09T17:52:54.184ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15762024-09-09T17:52:54.184ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15772024-09-09T17:52:54.184ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15782024-09-09T17:52:54.184ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15792024-09-09T17:52:54.184ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15802024-09-09T17:52:54.184ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15812024-09-09T17:52:54.184ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15822024-09-09T17:52:54.184ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15832024-09-09T17:52:54.205ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15842024-09-09T17:52:54.205ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15852024-09-09T17:52:54.205ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 99445748-3f8a-47eb-b03d-540bb23b7924, time_created: 2024-09-09T17:52:53.875750772Z, time_modified: 2024-09-09T17:52:53.875750772Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15862024-09-09T17:52:54.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15872024-09-09T17:52:54.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15882024-09-09T17:52:54.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15892024-09-09T17:52:54.209ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15902024-09-09T17:52:54.220ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: eaf34cef-e592-4e7c-b9f3-1a240bd6bcf6, time_created: 2024-09-09T17:52:53.875751143Z, time_modified: 2024-09-09T17:52:53.875751143Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2", variant: U2, sled_id: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15912024-09-09T17:52:54.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15922024-09-09T17:52:54.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15932024-09-09T17:52:54.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15942024-09-09T17:52:54.224ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15952024-09-09T17:52:54.228ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b3e70874-57ef-4fcb-9f44-a18b6a655d68, time_created: 2024-09-09T17:52:53.875751363Z, time_modified: 2024-09-09T17:52:53.875751363Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2", variant: U2, sled_id: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15962024-09-09T17:52:54.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15972024-09-09T17:52:54.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15982024-09-09T17:52:54.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
15992024-09-09T17:52:54.231ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16002024-09-09T17:52:54.235ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 3cca5293-4433-4956-b75c-0e6967d69a04, time_created: 2024-09-09T17:52:53.875751443Z, time_modified: 2024-09-09T17:52:53.875751443Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2", variant: U2, sled_id: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16012024-09-09T17:52:54.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16022024-09-09T17:52:54.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16032024-09-09T17:52:54.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16042024-09-09T17:52:54.238ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16052024-09-09T17:52:54.243ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 032350b3-5ef6-49e0-82b7-c2f6c5c3d580, time_created: 2024-09-09T17:52:53.875751512Z, time_modified: 2024-09-09T17:52:53.875751512Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2", variant: U2, sled_id: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16062024-09-09T17:52:54.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16072024-09-09T17:52:54.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16082024-09-09T17:52:54.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16092024-09-09T17:52:54.246ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16102024-09-09T17:52:54.249ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 8d6a3fc4-42ae-4137-8a4c-0c429a53310f, time_created: 2024-09-09T17:52:53.875751592Z, time_modified: 2024-09-09T17:52:53.875751592Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2", variant: U2, sled_id: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16112024-09-09T17:52:54.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16122024-09-09T17:52:54.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16132024-09-09T17:52:54.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16142024-09-09T17:52:54.253ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16152024-09-09T17:52:54.257ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 31811878-08d9-4dd7-82d9-61bcc051e746, time_created: 2024-09-09T17:52:53.875751672Z, time_modified: 2024-09-09T17:52:53.875751672Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2", variant: U2, sled_id: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16162024-09-09T17:52:54.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16172024-09-09T17:52:54.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16182024-09-09T17:52:54.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16192024-09-09T17:52:54.260ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16202024-09-09T17:52:54.263ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 6c038f91-337d-4974-956d-da4fd59787a8, time_created: 2024-09-09T17:52:53.875751743Z, time_modified: 2024-09-09T17:52:53.875751743Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2", variant: U2, sled_id: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16212024-09-09T17:52:54.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16222024-09-09T17:52:54.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16232024-09-09T17:52:54.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16242024-09-09T17:52:54.267ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16252024-09-09T17:52:54.270ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: e6df29c4-987d-4c4b-8971-6886a64153eb, time_created: 2024-09-09T17:52:53.875751823Z, time_modified: 2024-09-09T17:52:53.875751823Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2", variant: U2, sled_id: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16262024-09-09T17:52:54.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16272024-09-09T17:52:54.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16282024-09-09T17:52:54.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16292024-09-09T17:52:54.274ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16302024-09-09T17:52:54.277ZINFOnexus (dropshot_internal): Inserted physical disks actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:823 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16312024-09-09T17:52:54.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16322024-09-09T17:52:54.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16332024-09-09T17:52:54.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16342024-09-09T17:52:54.280ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16352024-09-09T17:52:54.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16362024-09-09T17:52:54.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16372024-09-09T17:52:54.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16382024-09-09T17:52:54.293ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16392024-09-09T17:52:54.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16402024-09-09T17:52:54.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16412024-09-09T17:52:54.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16422024-09-09T17:52:54.301ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16432024-09-09T17:52:54.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16442024-09-09T17:52:54.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16452024-09-09T17:52:54.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16462024-09-09T17:52:54.310ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16472024-09-09T17:52:54.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16482024-09-09T17:52:54.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16492024-09-09T17:52:54.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16502024-09-09T17:52:54.317ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16512024-09-09T17:52:54.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16522024-09-09T17:52:54.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16532024-09-09T17:52:54.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16542024-09-09T17:52:54.324ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16552024-09-09T17:52:54.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16562024-09-09T17:52:54.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16572024-09-09T17:52:54.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16582024-09-09T17:52:54.331ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16592024-09-09T17:52:54.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16602024-09-09T17:52:54.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16612024-09-09T17:52:54.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16622024-09-09T17:52:54.338ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16632024-09-09T17:52:54.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16642024-09-09T17:52:54.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16652024-09-09T17:52:54.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16662024-09-09T17:52:54.345ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16672024-09-09T17:52:54.349ZINFOnexus (dropshot_internal): Inserted zpools actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:835 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16682024-09-09T17:52:54.434ZINFOnexus (dropshot_internal): Inserted datasets actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:865 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16692024-09-09T17:52:54.460ZINFOnexus (dropshot_internal): Populated DNS tables for internal DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:876 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16702024-09-09T17:52:54.463ZINFOnexus (dropshot_internal): Populated DNS tables for external DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:885 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16712024-09-09T17:52:54.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16722024-09-09T17:52:54.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16732024-09-09T17:52:54.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16742024-09-09T17:52:54.467ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16752024-09-09T17:52:54.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16762024-09-09T17:52:54.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16772024-09-09T17:52:54.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16782024-09-09T17:52:54.469ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16792024-09-09T17:52:54.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16802024-09-09T17:52:54.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16812024-09-09T17:52:54.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16822024-09-09T17:52:54.517ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = DnsConfig result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16832024-09-09T17:52:54.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16842024-09-09T17:52:54.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16852024-09-09T17:52:54.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16862024-09-09T17:52:54.521ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = DnsConfig result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16872024-09-09T17:52:54.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16882024-09-09T17:52:54.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16892024-09-09T17:52:54.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16902024-09-09T17:52:54.527ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = DnsConfig result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16912024-09-09T17:52:54.541ZINFOnexus (dropshot_internal): Created recovery silo actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16922024-09-09T17:52:54.550ZINFOnexus (dropshot_internal): Created recovery user actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:467 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16932024-09-09T17:52:54.556ZINFOnexus (dropshot_internal): Created recovery user's password actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:481 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16942024-09-09T17:52:54.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16952024-09-09T17:52:54.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16962024-09-09T17:52:54.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16972024-09-09T17:52:54.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16982024-09-09T17:52:54.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
16992024-09-09T17:52:54.560ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17002024-09-09T17:52:54.560ZDEBGnexus (dropshot_internal): Generated role assignment queries actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17012024-09-09T17:52:54.564ZINFOnexus (dropshot_internal): Granted Silo privileges actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:509 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17022024-09-09T17:52:54.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17032024-09-09T17:52:54.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17042024-09-09T17:52:54.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17052024-09-09T17:52:54.567ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17062024-09-09T17:52:54.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17072024-09-09T17:52:54.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17082024-09-09T17:52:54.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17092024-09-09T17:52:54.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17102024-09-09T17:52:54.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17112024-09-09T17:52:54.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17122024-09-09T17:52:54.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17132024-09-09T17:52:54.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17142024-09-09T17:52:54.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17152024-09-09T17:52:54.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17162024-09-09T17:52:54.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17172024-09-09T17:52:54.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17182024-09-09T17:52:54.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17192024-09-09T17:52:54.600ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17202024-09-09T17:52:54.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17212024-09-09T17:52:54.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17222024-09-09T17:52:54.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17232024-09-09T17:52:54.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17242024-09-09T17:52:54.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17252024-09-09T17:52:54.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17262024-09-09T17:52:54.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17272024-09-09T17:52:54.614ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17282024-09-09T17:52:54.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17292024-09-09T17:52:54.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17302024-09-09T17:52:54.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17312024-09-09T17:52:54.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17322024-09-09T17:52:54.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17332024-09-09T17:52:54.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17342024-09-09T17:52:54.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17352024-09-09T17:52:54.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17362024-09-09T17:52:54.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17372024-09-09T17:52:54.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17382024-09-09T17:52:54.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17392024-09-09T17:52:54.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17402024-09-09T17:52:54.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17412024-09-09T17:52:54.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17422024-09-09T17:52:54.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17432024-09-09T17:52:54.649ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17442024-09-09T17:52:54.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17452024-09-09T17:52:54.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17462024-09-09T17:52:54.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17472024-09-09T17:52:54.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17482024-09-09T17:52:54.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17492024-09-09T17:52:54.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17502024-09-09T17:52:54.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17512024-09-09T17:52:54.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17522024-09-09T17:52:54.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17532024-09-09T17:52:54.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17542024-09-09T17:52:54.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17552024-09-09T17:52:54.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17562024-09-09T17:52:54.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17572024-09-09T17:52:54.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17582024-09-09T17:52:54.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17592024-09-09T17:52:54.662ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17602024-09-09T17:52:54.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17612024-09-09T17:52:54.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17622024-09-09T17:52:54.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17632024-09-09T17:52:54.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17642024-09-09T17:52:54.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17652024-09-09T17:52:54.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17662024-09-09T17:52:54.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17672024-09-09T17:52:54.669ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17682024-09-09T17:52:54.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17692024-09-09T17:52:54.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17702024-09-09T17:52:54.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17712024-09-09T17:52:54.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17722024-09-09T17:52:54.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17732024-09-09T17:52:54.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17742024-09-09T17:52:54.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17752024-09-09T17:52:54.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17762024-09-09T17:52:54.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17772024-09-09T17:52:54.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17782024-09-09T17:52:54.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17792024-09-09T17:52:54.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17802024-09-09T17:52:54.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17812024-09-09T17:52:54.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17822024-09-09T17:52:54.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17832024-09-09T17:52:54.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17842024-09-09T17:52:54.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17852024-09-09T17:52:54.688ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17862024-09-09T17:52:54.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17872024-09-09T17:52:54.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17882024-09-09T17:52:54.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17892024-09-09T17:52:54.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17902024-09-09T17:52:54.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17912024-09-09T17:52:54.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17922024-09-09T17:52:54.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17932024-09-09T17:52:54.695ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17942024-09-09T17:52:54.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17952024-09-09T17:52:54.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17962024-09-09T17:52:54.702ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 5db99faa-847d-4c67-baad-c7351bdbf8f8, kind: Service { id: 07c1bbdd-f080-4837-9528-41234be47bda }, name: Name("external-dns-07c1bbdd-f080-4837-9528-41234be47bda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ffc9837e-602d-49be-aea3-1a5919d80850, kind: Service { id: 9711344c-11c4-490b-9560-e9c007eb0cf3 }, name: Name("external-dns-9711344c-11c4-490b-9560-e9c007eb0cf3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 2b31f448-70f4-4ab8-9cd0-36ff4c28255b, kind: Service { id: ca022d43-3da4-4507-941c-6fd9da5b668d }, name: Name("nexus-ca022d43-3da4-4507-941c-6fd9da5b668d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 49852929-112c-4ccc-bc3e-c924ce561472, kind: Service { id: fd75f244-5e91-4f63-b3b2-ae4139e91823 }, name: Name("nexus-fd75f244-5e91-4f63-b3b2-ae4139e91823"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 64])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f29fffc4-b4e4-4069-af7f-4a0100b36168, kind: Service { id: 4c6ef9f1-4001-4c65-ae99-bafe915b66f8 }, name: Name("nexus-4c6ef9f1-4001-4c65-ae99-bafe915b66f8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 44])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
17972024-09-09T17:52:54.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17982024-09-09T17:52:54.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
17992024-09-09T17:52:54.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
18002024-09-09T17:52:54.705ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Fleet result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
18012024-09-09T17:52:54.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 roles = RoleSet { roles: {} } uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
18022024-09-09T17:52:54.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 resource = Database result = Ok(()) uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
18032024-09-09T17:52:54.707ZDEBGnexus: Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
18042024-09-09T17:52:54.708ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5db99faa-847d-4c67-baad-c7351bdbf8f8, kind: Service { id: 07c1bbdd-f080-4837-9528-41234be47bda }, name: Name("external-dns-07c1bbdd-f080-4837-9528-41234be47bda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ffc9837e-602d-49be-aea3-1a5919d80850, kind: Service { id: 9711344c-11c4-490b-9560-e9c007eb0cf3 }, name: Name("external-dns-9711344c-11c4-490b-9560-e9c007eb0cf3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2b31f448-70f4-4ab8-9cd0-36ff4c28255b, kind: Service { id: ca022d43-3da4-4507-941c-6fd9da5b668d }, name: Name("nexus-ca022d43-3da4-4507-941c-6fd9da5b668d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 49852929-112c-4ccc-bc3e-c924ce561472, kind: Service { id: fd75f244-5e91-4f63-b3b2-ae4139e91823 }, name: Name("nexus-fd75f244-5e91-4f63-b3b2-ae4139e91823"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 64])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f29fffc4-b4e4-4069-af7f-4a0100b36168, kind: Service { id: 4c6ef9f1-4001-4c65-ae99-bafe915b66f8 }, name: Name("nexus-4c6ef9f1-4001-4c65-ae99-bafe915b66f8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 44])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
18052024-09-09T17:52:54.708ZDEBGnexus: resolved 2 rules for sleds
18062024-09-09T17:52:54.753ZDEBGnexus: resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, time_created: 2024-09-09T17:52:49.417856Z, time_modified: 2024-09-09T17:52:49.417856Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
18072024-09-09T17:52:54.753ZDEBGnexus: sending firewall rules to sled agents
18082024-09-09T17:52:54.753ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
18092024-09-09T17:52:54.753ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
18102024-09-09T17:52:54.755ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
18112024-09-09T17:52:54.755ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
18122024-09-09T17:52:54.756ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
18132024-09-09T17:52:54.758ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
18142024-09-09T17:52:54.788ZDEBGnexus: client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18152024-09-09T17:52:54.794ZDEBGnexus: client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "521d2f0e-6512-419f-bea2-29a91399f4c3", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
18162024-09-09T17:52:54.795ZINFOnexus: updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
18172024-09-09T17:52:54.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Signaled
18182024-09-09T17:52:54.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Signaled
18192024-09-09T17:52:54.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Signaled
18202024-09-09T17:52:54.795ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
18212024-09-09T17:52:54.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18222024-09-09T17:52:54.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 924513 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34384 req_id = 40e7c757-6180-4758-8a2b-2a676de9bdb1 response_code = 204 uri = /racks/1068bc7e-e3ab-44f6-b097-299854b0081f/initialization-complete
18232024-09-09T17:52:54.795ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Signaled
18242024-09-09T17:52:54.795ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18252024-09-09T17:52:54.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Signaled
18262024-09-09T17:52:54.795ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
18272024-09-09T17:52:54.795ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
18282024-09-09T17:52:54.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18292024-09-09T17:52:54.795ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18302024-09-09T17:52:54.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18312024-09-09T17:52:54.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18322024-09-09T17:52:54.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
18332024-09-09T17:52:54.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18342024-09-09T17:52:54.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18352024-09-09T17:52:54.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18362024-09-09T17:52:54.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18372024-09-09T17:52:54.797ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("21f5073c-362d-497d-ae9e-f6ab85374703.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("42b0964a-b1a3-443e-b006-c18e1ad8d003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 33696, tv_nsec: 405532050 } })
18382024-09-09T17:52:54.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18392024-09-09T17:52:54.797ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("07c1bbdd-f080-4837-9528-41234be47bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 33696, tv_nsec: 405968472 } })
18402024-09-09T17:52:54.798ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18412024-09-09T17:52:54.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18422024-09-09T17:52:54.798ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18432024-09-09T17:52:54.799ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
18442024-09-09T17:52:54.799ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.503361ms iteration = 2 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
18452024-09-09T17:52:54.799ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
18462024-09-09T17:52:54.799ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.55756ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
18472024-09-09T17:52:54.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18482024-09-09T17:52:54.800ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
18492024-09-09T17:52:54.800ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18502024-09-09T17:52:54.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
18512024-09-09T17:52:54.801ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18522024-09-09T17:52:54.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18532024-09-09T17:52:54.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18542024-09-09T17:52:54.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18552024-09-09T17:52:54.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18562024-09-09T17:52:54.803ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18572024-09-09T17:52:54.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18582024-09-09T17:52:54.805ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18592024-09-09T17:52:54.806ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
18602024-09-09T17:52:54.806ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
18612024-09-09T17:52:54.806ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
18622024-09-09T17:52:54.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18632024-09-09T17:52:54.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18642024-09-09T17:52:54.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
18652024-09-09T17:52:54.807ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18662024-09-09T17:52:54.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18672024-09-09T17:52:54.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18682024-09-09T17:52:54.809ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(90bcdee1-9019-49bb-9eab-8a4212410b7a, 0), (87fbfdfd-bfc3-4804-8221-9e0fb079a831, 0), (618410ee-0f83-47f5-8944-bbde179a5c46, 0), (efb5d424-0342-4970-b96f-ab7907e387a7, 0)] collection_id = 90bcdee1-9019-49bb-9eab-8a4212410b7a
18692024-09-09T17:52:54.809ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18702024-09-09T17:52:54.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
18712024-09-09T17:52:54.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18722024-09-09T17:52:54.810ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18732024-09-09T17:52:54.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18742024-09-09T17:52:54.833ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
18752024-09-09T17:52:54.833ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
18762024-09-09T17:52:54.833ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
18772024-09-09T17:52:54.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18782024-09-09T17:52:54.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18792024-09-09T17:52:54.835ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 90bcdee1-9019-49bb-9eab-8a4212410b7a file = nexus/db-queries/src/db/datastore/inventory.rs:1299 ncabooses = 12 ncollections = 1 nerrors = 0 nnics = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
18802024-09-09T17:52:54.835ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18812024-09-09T17:52:54.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18822024-09-09T17:52:54.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
18832024-09-09T17:52:54.838ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(87fbfdfd-bfc3-4804-8221-9e0fb079a831, 0), (618410ee-0f83-47f5-8944-bbde179a5c46, 0), (efb5d424-0342-4970-b96f-ab7907e387a7, 0)]
18842024-09-09T17:52:54.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18852024-09-09T17:52:54.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18862024-09-09T17:52:54.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18872024-09-09T17:52:54.838ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33696, tv_nsec: 447208804 } })
18882024-09-09T17:52:54.848ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18892024-09-09T17:52:54.848ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
18902024-09-09T17:52:54.848ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
18912024-09-09T17:52:54.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18922024-09-09T17:52:54.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18932024-09-09T17:52:54.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18942024-09-09T17:52:54.850ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18952024-09-09T17:52:54.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18962024-09-09T17:52:54.851ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
18972024-09-09T17:52:54.851ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 0 version = 2
18982024-09-09T17:52:54.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18992024-09-09T17:52:54.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19002024-09-09T17:52:54.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19012024-09-09T17:52:54.852ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19022024-09-09T17:52:54.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19032024-09-09T17:52:54.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19042024-09-09T17:52:54.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19052024-09-09T17:52:54.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19062024-09-09T17:52:54.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19072024-09-09T17:52:54.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19082024-09-09T17:52:54.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19092024-09-09T17:52:54.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19102024-09-09T17:52:54.858ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 1 version = 2
19112024-09-09T17:52:54.858ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
19122024-09-09T17:52:54.858ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
19132024-09-09T17:52:54.858ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 63.02475ms iteration = 2 status = {"generation":2}
19142024-09-09T17:52:54.858ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Dependency
19152024-09-09T17:52:54.865ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
19162024-09-09T17:52:54.865ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
19172024-09-09T17:52:54.865ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
19182024-09-09T17:52:54.865ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 70.01926ms iteration = 2 status = {"generation":1}
19192024-09-09T17:52:54.865ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Dependency
19202024-09-09T17:52:54.884ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-09T17:52:21.456201Z, time_modified: 2024-09-09T17:52:21.456201Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
19212024-09-09T17:52:54.884ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 88.8134ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]}},"default_endpoint":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
19222024-09-09T17:52:54.894ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
19232024-09-09T17:52:54.894ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
19242024-09-09T17:52:54.894ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
19252024-09-09T17:52:54.895ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/ignition", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6dc8991f-bef3-47cf-98d2-8eb0dc19a90e", "content-length": "476", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19262024-09-09T17:52:54.895ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
19272024-09-09T17:52:54.896ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a7663fc9-ee3a-43b4-b27a-ffab68857474", "content-length": "734", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19282024-09-09T17:52:54.896ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
19292024-09-09T17:52:54.896ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5212c045-7fdd-4f3f-bff5-52f56a930031", "content-length": "86", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19302024-09-09T17:52:54.896ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
19312024-09-09T17:52:54.896ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a4dd1525-d5dc-4455-a218-00cead7ccc5f", "content-length": "86", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19322024-09-09T17:52:54.896ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
19332024-09-09T17:52:54.896ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3c6ea203-1958-4deb-bbad-a6ef21f9e98d", "content-length": "80", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19342024-09-09T17:52:54.896ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
19352024-09-09T17:52:54.896ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e16c4b68-fa62-475e-89d3-182a96e51c74", "content-length": "80", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19362024-09-09T17:52:54.896ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
19372024-09-09T17:52:54.897ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c9f865ee-fa70-4cf8-818d-c55a7c21f674", "content-length": "88", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19382024-09-09T17:52:54.897ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
19392024-09-09T17:52:54.897ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9ba37989-e822-484e-b743-c63456a5fc2b", "content-length": "88", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19402024-09-09T17:52:54.897ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
19412024-09-09T17:52:54.897ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b310996d-3641-4dd4-bf85-c69c9f652710", "content-length": "702", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19422024-09-09T17:52:54.897ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
19432024-09-09T17:52:54.897ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "65bb3869-42a9-4573-894e-aa245607fb5e", "content-length": "727", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19442024-09-09T17:52:54.897ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
19452024-09-09T17:52:54.897ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f389c897-a70c-4a88-a9b0-8f396ce49edd", "content-length": "729", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19462024-09-09T17:52:54.898ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
19472024-09-09T17:52:54.899ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a700ea56-0d94-449a-b426-1c13c7e7e501", "content-length": "728", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19482024-09-09T17:52:54.899ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
19492024-09-09T17:52:54.899ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "589a5117-958a-4f0b-afbf-3670ef4cec5e", "content-length": "722", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19502024-09-09T17:52:54.899ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
19512024-09-09T17:52:54.899ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3d9a471e-3bb9-4b68-8fbc-2c3155951eb6", "content-length": "84", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19522024-09-09T17:52:54.899ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
19532024-09-09T17:52:54.899ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "45ee0796-563b-47fd-b8b3-9e99b6f503db", "content-length": "84", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19542024-09-09T17:52:54.899ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
19552024-09-09T17:52:54.899ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "463f3bd6-ded1-4736-8fd5-7700edc51557", "content-length": "82", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19562024-09-09T17:52:54.899ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
19572024-09-09T17:52:54.900ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8ebdafe3-e30d-4fb2-ba67-74cec32adfaa", "content-length": "82", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19582024-09-09T17:52:54.900ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
19592024-09-09T17:52:54.900ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "35fcb43b-752b-406f-ae9f-19041335bb0d", "content-length": "91", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19602024-09-09T17:52:54.900ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
19612024-09-09T17:52:54.901ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f027060a-b5bb-4064-98e0-f8c80ccbcd0a", "content-length": "91", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19622024-09-09T17:52:54.901ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
19632024-09-09T17:52:54.901ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1d508aa1-8a1a-426a-a80f-499b20d20057", "content-length": "702", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19642024-09-09T17:52:54.901ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
19652024-09-09T17:52:54.901ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c149a492-bedb-4143-a8b6-833e61f66c90", "content-length": "727", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19662024-09-09T17:52:54.901ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
19672024-09-09T17:52:54.901ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c0bdbb77-5693-444b-8eb7-ff38e11e9c9c", "content-length": "729", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19682024-09-09T17:52:54.901ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
19692024-09-09T17:52:54.902ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7a43fb84-a0f0-4391-8105-d2370b656ea7", "content-length": "728", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19702024-09-09T17:52:54.902ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
19712024-09-09T17:52:54.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
19722024-09-09T17:52:54.904ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19732024-09-09T17:52:54.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
19742024-09-09T17:52:54.906ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
19752024-09-09T17:52:54.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
19762024-09-09T17:52:54.908ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19772024-09-09T17:52:54.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
19782024-09-09T17:52:54.909ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
19792024-09-09T17:52:54.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
19802024-09-09T17:52:54.935ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
19812024-09-09T17:52:54.938ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
19822024-09-09T17:52:54.989ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
19832024-09-09T17:52:54.989ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
19842024-09-09T17:52:55.003ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
19852024-09-09T17:52:55.016ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
19862024-09-09T17:52:55.042ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cb7f28ef-5624-4c0c-92ea-a043c4c2d32a", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19872024-09-09T17:52:55.042ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19882024-09-09T17:52:55.043ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
19892024-09-09T17:52:55.050ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "15272d1f-ec2a-4055-96ef-20536de11867", "date": "Mon, 09 Sep 2024 17:52:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19902024-09-09T17:52:55.050ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19912024-09-09T17:52:55.051ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19922024-09-09T17:52:55.051ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 193.111001ms iteration = 3 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
19932024-09-09T17:52:55.068ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2354a0dd-d260-4f57-9868-cf967ec4fbae", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
19942024-09-09T17:52:55.068ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
19952024-09-09T17:52:55.069ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c30d8051-8110-42fe-b07e-8073d5c78bee", "date": "Mon, 09 Sep 2024 17:52:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
19962024-09-09T17:52:55.069ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
19972024-09-09T17:52:55.079ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/inventory", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "14d7aed0-1daa-40cf-a2ce-72fd2c5532e6", "content-length": "2362", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
19982024-09-09T17:52:55.081ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/omicron-zones
19992024-09-09T17:52:55.082ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/omicron-zones", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "41aac253-afae-4548-9506-50648ebec531", "content-length": "10314", "date": "Mon, 09 Sep 2024 17:52:55 GMT"} })
20002024-09-09T17:52:55.086ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
20012024-09-09T17:52:55.086ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
20022024-09-09T17:52:55.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
20032024-09-09T17:52:55.088ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20042024-09-09T17:52:55.090ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
20052024-09-09T17:52:55.092ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
20062024-09-09T17:52:55.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
20072024-09-09T17:52:55.096ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e4e4e77b-46d9-47b0-80a7-22d6e263437f", "date": "Mon, 09 Sep 2024 17:52:55 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20082024-09-09T17:52:55.096ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20092024-09-09T17:52:55.098ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20102024-09-09T17:52:55.098ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 232.758614ms iteration = 3 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
20112024-09-09T17:52:55.213ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
20122024-09-09T17:52:55.214ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
20132024-09-09T17:52:55.215ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
20142024-09-09T17:52:55.215ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
20152024-09-09T17:52:55.217ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20162024-09-09T17:52:55.217ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 3cf7f19e-d953-4d87-9bda-041b645252d3 file = nexus/db-queries/src/db/datastore/inventory.rs:893
20172024-09-09T17:52:55.219ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 3cf7f19e-d953-4d87-9bda-041b645252d3 time_started = 2024-09-09 17:52:54.893944 UTC
20182024-09-09T17:52:55.219ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 423.39087ms iteration = 2 status = {"collection_id":"3cf7f19e-d953-4d87-9bda-041b645252d3","time_done":"2024-09-09 17:52:55.086524 UTC","time_started":"2024-09-09 17:52:54.893944 UTC"}
20192024-09-09T17:52:55.219ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Dependency
20202024-09-09T17:52:55.219ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20212024-09-09T17:52:55.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20222024-09-09T17:52:55.219ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 1068bc7e-e3ab-44f6-b097-299854b0081f, lookup_type: ById(1068bc7e-e3ab-44f6-b097-299854b0081f) } result = Ok(())
20232024-09-09T17:52:55.219ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:762
20242024-09-09T17:52:55.219ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20252024-09-09T17:52:55.219ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20262024-09-09T17:52:55.220ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20272024-09-09T17:52:55.221ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20282024-09-09T17:52:55.221ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20292024-09-09T17:52:55.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20302024-09-09T17:52:55.222ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20312024-09-09T17:52:55.222ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20322024-09-09T17:52:55.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20332024-09-09T17:52:55.222ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20342024-09-09T17:52:55.224ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20352024-09-09T17:52:55.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20362024-09-09T17:52:55.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20372024-09-09T17:52:55.224ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20382024-09-09T17:52:55.225ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20392024-09-09T17:52:55.226ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20402024-09-09T17:52:55.226ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20412024-09-09T17:52:55.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20422024-09-09T17:52:55.227ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20432024-09-09T17:52:55.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20442024-09-09T17:52:55.227ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20452024-09-09T17:52:55.227ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20462024-09-09T17:52:55.229ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20472024-09-09T17:52:55.231ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
20482024-09-09T17:52:55.231ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20492024-09-09T17:52:55.232ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20502024-09-09T17:52:55.232ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20512024-09-09T17:52:55.233ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20522024-09-09T17:52:55.234ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20532024-09-09T17:52:55.234ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20542024-09-09T17:52:55.235ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20552024-09-09T17:52:55.238ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
20562024-09-09T17:52:55.238ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20572024-09-09T17:52:55.238ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 19.033432ms iteration = 4 status = {"physical_disks_added":0}
20582024-09-09T17:52:55.238ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20592024-09-09T17:52:55.240ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20602024-09-09T17:52:55.240ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20612024-09-09T17:52:55.241ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20622024-09-09T17:52:55.241ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20632024-09-09T17:52:55.243ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20642024-09-09T17:52:55.243ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20652024-09-09T17:52:55.244ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20662024-09-09T17:52:55.244ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20672024-09-09T17:52:55.245ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20682024-09-09T17:52:55.246ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20692024-09-09T17:52:55.247ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20702024-09-09T17:52:55.247ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20712024-09-09T17:52:55.248ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20722024-09-09T17:52:55.251ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
20732024-09-09T17:52:55.251ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20742024-09-09T17:52:55.251ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20752024-09-09T17:52:55.252ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20762024-09-09T17:52:55.253ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20772024-09-09T17:52:55.254ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20782024-09-09T17:52:55.254ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20792024-09-09T17:52:55.256ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20802024-09-09T17:52:55.256ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20812024-09-09T17:52:55.258ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20822024-09-09T17:52:55.258ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20832024-09-09T17:52:55.260ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20842024-09-09T17:52:55.260ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20852024-09-09T17:52:55.262ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20862024-09-09T17:52:55.263ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20872024-09-09T17:52:55.264ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20882024-09-09T17:52:55.267ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
20892024-09-09T17:52:55.267ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20902024-09-09T17:52:55.267ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20912024-09-09T17:52:55.269ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20922024-09-09T17:52:55.269ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20932024-09-09T17:52:55.270ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20942024-09-09T17:52:55.270ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20952024-09-09T17:52:55.271ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20962024-09-09T17:52:55.274ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
20972024-09-09T17:52:55.274ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
20982024-09-09T17:52:55.274ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
20992024-09-09T17:52:55.278ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
21002024-09-09T17:52:55.279ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21012024-09-09T17:52:55.280ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
21022024-09-09T17:52:55.280ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21032024-09-09T17:52:55.281ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
21042024-09-09T17:52:55.281ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21052024-09-09T17:52:55.283ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
21062024-09-09T17:52:55.284ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21072024-09-09T17:52:55.286ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
21082024-09-09T17:52:55.286ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21092024-09-09T17:52:55.287ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
21102024-09-09T17:52:55.287ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21112024-09-09T17:52:55.288ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
21122024-09-09T17:52:55.288ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21132024-09-09T17:52:55.290ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21142024-09-09T17:52:55.293ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
21152024-09-09T17:52:55.293ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
21162024-09-09T17:52:55.293ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21172024-09-09T17:52:55.294ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
21182024-09-09T17:52:55.294ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21192024-09-09T17:52:55.295ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
21202024-09-09T17:52:55.295ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21212024-09-09T17:52:55.296ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21222024-09-09T17:52:55.299ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
21232024-09-09T17:52:55.299ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
21242024-09-09T17:52:55.299ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21252024-09-09T17:52:55.305ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 2b31f448-70f4-4ab8-9cd0-36ff4c28255b, kind: Service { id: ca022d43-3da4-4507-941c-6fd9da5b668d }, name: Name("nexus-ca022d43-3da4-4507-941c-6fd9da5b668d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 49852929-112c-4ccc-bc3e-c924ce561472, kind: Service { id: fd75f244-5e91-4f63-b3b2-ae4139e91823 }, name: Name("nexus-fd75f244-5e91-4f63-b3b2-ae4139e91823"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 64])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f29fffc4-b4e4-4069-af7f-4a0100b36168, kind: Service { id: 4c6ef9f1-4001-4c65-ae99-bafe915b66f8 }, name: Name("nexus-4c6ef9f1-4001-4c65-ae99-bafe915b66f8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 44])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 5db99faa-847d-4c67-baad-c7351bdbf8f8, kind: Service { id: 07c1bbdd-f080-4837-9528-41234be47bda }, name: Name("external-dns-07c1bbdd-f080-4837-9528-41234be47bda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ffc9837e-602d-49be-aea3-1a5919d80850, kind: Service { id: 9711344c-11c4-490b-9560-e9c007eb0cf3 }, name: Name("external-dns-9711344c-11c4-490b-9560-e9c007eb0cf3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
21262024-09-09T17:52:55.305ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
21272024-09-09T17:52:55.305ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21282024-09-09T17:52:55.306ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21292024-09-09T17:52:55.308ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
21302024-09-09T17:52:55.308ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
21312024-09-09T17:52:55.308ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21322024-09-09T17:52:55.309ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
21332024-09-09T17:52:55.310ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5db99faa-847d-4c67-baad-c7351bdbf8f8, kind: Service { id: 07c1bbdd-f080-4837-9528-41234be47bda }, name: Name("external-dns-07c1bbdd-f080-4837-9528-41234be47bda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ffc9837e-602d-49be-aea3-1a5919d80850, kind: Service { id: 9711344c-11c4-490b-9560-e9c007eb0cf3 }, name: Name("external-dns-9711344c-11c4-490b-9560-e9c007eb0cf3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2b31f448-70f4-4ab8-9cd0-36ff4c28255b, kind: Service { id: ca022d43-3da4-4507-941c-6fd9da5b668d }, name: Name("nexus-ca022d43-3da4-4507-941c-6fd9da5b668d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 49852929-112c-4ccc-bc3e-c924ce561472, kind: Service { id: fd75f244-5e91-4f63-b3b2-ae4139e91823 }, name: Name("nexus-fd75f244-5e91-4f63-b3b2-ae4139e91823"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 64])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f29fffc4-b4e4-4069-af7f-4a0100b36168, kind: Service { id: 4c6ef9f1-4001-4c65-ae99-bafe915b66f8 }, name: Name("nexus-4c6ef9f1-4001-4c65-ae99-bafe915b66f8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 44])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
21342024-09-09T17:52:55.310ZDEBGnexus (InternalApi): resolved 2 rules for sleds
21352024-09-09T17:52:55.352ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, time_created: 2024-09-09T17:52:49.417856Z, time_modified: 2024-09-09T17:52:49.417856Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
21362024-09-09T17:52:55.352ZDEBGnexus (InternalApi): sending firewall rules to sled agents
21372024-09-09T17:52:55.352ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
21382024-09-09T17:52:55.352ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21392024-09-09T17:52:55.354ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
21402024-09-09T17:52:55.355ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
21412024-09-09T17:52:55.356ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21422024-09-09T17:52:55.358ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
21432024-09-09T17:52:55.389ZDEBGnexus (InternalApi): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21442024-09-09T17:52:55.389ZDEBGnexus (InternalApi): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "18dac836-493f-402c-a8e9-60b9b5795154", "date": "Mon, 09 Sep 2024 17:52:54 GMT"} })
21452024-09-09T17:52:55.390ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
21462024-09-09T17:52:55.390ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
21472024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /
21482024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access
21492024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path}
21502024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth
21512024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm
21522024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success
21532024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token
21542024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify
21552024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes
21562024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes
21572024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe}
21582024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe}
21592024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images
21602024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login
21612024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local
21622024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}
21632024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name}
21642024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
21652024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path}
21662024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path}
21672024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new
21682024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path}
21692024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path}
21702024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization
21712024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates
21722024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates
21732024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate}
21742024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate}
21752024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks
21762024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks
21772024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk}
21782024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}
21792024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write
21802024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start
21812024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop
21822024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize
21832024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric}
21842024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips
21852024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips
21862024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip}
21872024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip}
21882024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip}
21892024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach
21902024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach
21912024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups
21922024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id}
21932024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images
21942024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images
21952024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image}
21962024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image}
21972024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote
21982024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote
21992024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances
22002024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances
22012024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}
22022024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}
22032024-09-09T17:52:55.407ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks
22042024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach
22052024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach
22062024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips
22072024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
22082024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
22092024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot
22102024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console
22112024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream
22122024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys
22132024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start
22142024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop
22152024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools
22162024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool}
22172024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local
22182024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout
22192024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me
22202024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups
22212024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys
22222024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys
22232024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
22242024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key}
22252024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name}
22262024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces
22272024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces
22282024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface}
22292024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface}
22302024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface}
22312024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping
22322024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy
22332024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy
22342024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects
22352024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects
22362024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project}
22372024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}
22382024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}
22392024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy
22402024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy
22412024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots
22422024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots
22432024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot}
22442024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot}
22452024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks
22462024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id}
22472024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks
22482024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id}
22492024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds
22502024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds
22512024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}
22522024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
22532024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
22542024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
22552024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized
22562024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port
22572024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
22582024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings
22592024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status
22602024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches
22612024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id}
22622024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers
22632024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users
22642024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
22652024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
22662024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml
22672024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider}
22682024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools
22692024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools
22702024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}
22712024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}
22722024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}
22732024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges
22742024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
22752024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
22762024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos
22772024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos
22782024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
22792024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
22802024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization
22812024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service
22822024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges
22832024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add
22842024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove
22852024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name}
22862024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot
22872024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot
22882024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
22892024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
22902024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list
22912024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list
22922024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable
22932024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable
22942024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status
22952024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp
22962024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp
22972024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp
22982024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set
22992024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set
23002024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{name_or_id}
23012024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{name_or_id}/announcement
23022024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported
23032024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history
23042024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4
23052024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status
23062024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address
23072024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address
23082024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
23092024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings
23102024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings
23112024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings
23122024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port}
23132024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy
23142024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy
23152024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles
23162024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name}
23172024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas
23182024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos
23192024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos
23202024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo}
23212024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}
23222024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools
23232024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy
23242024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy
23252024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas
23262024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas
23272024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository
23282024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version}
23292024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users
23302024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id}
23312024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin
23322024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user}
23332024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos
23342024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo}
23352024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/timeseries/query
23362024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/timeseries/schema
23372024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users
23382024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization
23392024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules
23402024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules
23412024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes
23422024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes
23432024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route}
23442024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route}
23452024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route}
23462024-09-09T17:52:55.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers
23472024-09-09T17:52:55.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers
23482024-09-09T17:52:55.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router}
23492024-09-09T17:52:55.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router}
23502024-09-09T17:52:55.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router}
23512024-09-09T17:52:55.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets
23522024-09-09T17:52:55.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets
23532024-09-09T17:52:55.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet}
23542024-09-09T17:52:55.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}
23552024-09-09T17:52:55.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet}
23562024-09-09T17:52:55.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
23572024-09-09T17:52:55.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs
23582024-09-09T17:52:55.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs
23592024-09-09T17:52:55.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc}
23602024-09-09T17:52:55.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc}
23612024-09-09T17:52:55.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc}
23622024-09-09T17:52:55.409ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = 172.30.2.7:443
23632024-09-09T17:52:55.409ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
23642024-09-09T17:52:55.411ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" } server_name = recovery.sys.oxide.test silo_id = 8dd86d6f-ad2d-45da-852c-8351c18c2cc5
23652024-09-09T17:52:55.412ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /
23662024-09-09T17:52:55.412ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access
23672024-09-09T17:52:55.412ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path}
23682024-09-09T17:52:55.412ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth
23692024-09-09T17:52:55.412ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm
23702024-09-09T17:52:55.412ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success
23712024-09-09T17:52:55.412ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token
23722024-09-09T17:52:55.412ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify
23732024-09-09T17:52:55.412ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes
23742024-09-09T17:52:55.412ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes
23752024-09-09T17:52:55.412ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe}
23762024-09-09T17:52:55.412ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe}
23772024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images
23782024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login
23792024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local
23802024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}
23812024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name}
23822024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
23832024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path}
23842024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path}
23852024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new
23862024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path}
23872024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path}
23882024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization
23892024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates
23902024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates
23912024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate}
23922024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate}
23932024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks
23942024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks
23952024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk}
23962024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}
23972024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write
23982024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start
23992024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop
24002024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize
24012024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric}
24022024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips
24032024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips
24042024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip}
24052024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip}
24062024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip}
24072024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach
24082024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach
24092024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups
24102024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id}
24112024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images
24122024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images
24132024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image}
24142024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image}
24152024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote
24162024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote
24172024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances
24182024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances
24192024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}
24202024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}
24212024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks
24222024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach
24232024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach
24242024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips
24252024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
24262024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
24272024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot
24282024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console
24292024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream
24302024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys
24312024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start
24322024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop
24332024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools
24342024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool}
24352024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local
24362024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout
24372024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me
24382024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups
24392024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys
24402024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys
24412024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
24422024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key}
24432024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name}
24442024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces
24452024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces
24462024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface}
24472024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface}
24482024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface}
24492024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping
24502024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy
24512024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy
24522024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects
24532024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects
24542024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project}
24552024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}
24562024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}
24572024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy
24582024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy
24592024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots
24602024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots
24612024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot}
24622024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot}
24632024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks
24642024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id}
24652024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks
24662024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id}
24672024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds
24682024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds
24692024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}
24702024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
24712024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
24722024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
24732024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized
24742024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port
24752024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
24762024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings
24772024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status
24782024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches
24792024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id}
24802024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers
24812024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users
24822024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
24832024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
24842024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml
24852024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider}
24862024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools
24872024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools
24882024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}
24892024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}
24902024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}
24912024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges
24922024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
24932024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
24942024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos
24952024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos
24962024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
24972024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
24982024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization
24992024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service
25002024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges
25012024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add
25022024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove
25032024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name}
25042024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot
25052024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot
25062024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
25072024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
25082024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list
25092024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list
25102024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable
25112024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable
25122024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status
25132024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp
25142024-09-09T17:52:55.413ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp
25152024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp
25162024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set
25172024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set
25182024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{name_or_id}
25192024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{name_or_id}/announcement
25202024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported
25212024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history
25222024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4
25232024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status
25242024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address
25252024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address
25262024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
25272024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings
25282024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings
25292024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings
25302024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port}
25312024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy
25322024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy
25332024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles
25342024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name}
25352024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas
25362024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos
25372024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos
25382024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo}
25392024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}
25402024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools
25412024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy
25422024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy
25432024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas
25442024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas
25452024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository
25462024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version}
25472024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users
25482024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id}
25492024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin
25502024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user}
25512024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos
25522024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo}
25532024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/timeseries/query
25542024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/timeseries/schema
25552024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users
25562024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization
25572024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules
25582024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules
25592024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes
25602024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes
25612024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route}
25622024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route}
25632024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route}
25642024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers
25652024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers
25662024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router}
25672024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router}
25682024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router}
25692024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets
25702024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets
25712024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet}
25722024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}
25732024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet}
25742024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
25752024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs
25762024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs
25772024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc}
25782024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc}
25792024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc}
25802024-09-09T17:52:55.414ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::c]:12228
25812024-09-09T17:52:55.414ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
25822024-09-09T17:52:55.414ZDEBGnexus (nexus-producer-server): registered DTrace probes
25832024-09-09T17:52:55.420ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:48561 method = GET path = /{producer_id}
25842024-09-09T17:52:55.420ZINFOnexus (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::c]:48561
25852024-09-09T17:52:55.420ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:48561
25862024-09-09T17:52:55.420ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:48561
25872024-09-09T17:52:55.420ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
25882024-09-09T17:52:55.420ZDEBGnexus (nexus-producer-server): starting producer registration task
25892024-09-09T17:52:55.421ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:48561 file = oximeter/producer/src/lib.rs:283 interval = 10s producer_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
25902024-09-09T17:52:55.421ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
25912024-09-09T17:52:55.421ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
25922024-09-09T17:52:55.422ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = 172.30.2.7:443 remote_addr = 10.151.1.100:61592
25932024-09-09T17:52:55.427ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25942024-09-09T17:52:55.428ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25952024-09-09T17:52:55.431ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25962024-09-09T17:52:55.431ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25972024-09-09T17:52:55.433ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25982024-09-09T17:52:55.433ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25992024-09-09T17:52:55.434ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26002024-09-09T17:52:55.435ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ByName("recovery") } result = Ok(())
26012024-09-09T17:52:55.435ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26022024-09-09T17:52:55.435ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26032024-09-09T17:52:55.437ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26042024-09-09T17:52:55.437ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26052024-09-09T17:52:55.439ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26062024-09-09T17:52:55.441ZDEBGnexus (ExternalAuthn): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ByName("recovery") } result = Ok(())
26072024-09-09T17:52:55.441ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26082024-09-09T17:52:55.441ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26092024-09-09T17:52:55.454ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26102024-09-09T17:52:55.454ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26112024-09-09T17:52:55.454ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
26122024-09-09T17:52:55.454ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:62188
26132024-09-09T17:52:55.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62188 req_id = 46269c82-f041-4fa3-b233-eef1dfcbd777 roles = RoleSet { roles: {} } uri = /metrics/producers
26142024-09-09T17:52:55.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62188 req_id = 46269c82-f041-4fa3-b233-eef1dfcbd777 resource = Database result = Ok(()) uri = /metrics/producers
26152024-09-09T17:52:55.455ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26162024-09-09T17:52:55.455ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26172024-09-09T17:52:55.457ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26182024-09-09T17:52:55.458ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ByName("recovery") }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ByName("recovery") } result = Ok(())
26192024-09-09T17:52:55.458ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26202024-09-09T17:52:55.458ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26212024-09-09T17:52:55.489ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
26222024-09-09T17:52:55.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62188 req_id = 46269c82-f041-4fa3-b233-eef1dfcbd777 roles = RoleSet { roles: {} } uri = /metrics/producers
26232024-09-09T17:52:55.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62188 req_id = 46269c82-f041-4fa3-b233-eef1dfcbd777 resource = Database result = Ok(()) uri = /metrics/producers
26242024-09-09T17:52:55.498ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
26252024-09-09T17:52:55.499ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "795f6bf7-2127-4420-8958-a9b03908f2a9", "date": "Mon, 09 Sep 2024 17:52:55 GMT"} })
26262024-09-09T17:52:55.499ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
26272024-09-09T17:52:55.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 46790 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62188 req_id = 46269c82-f041-4fa3-b233-eef1dfcbd777 response_code = 201 uri = /metrics/producers
26282024-09-09T17:52:55.501ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "46269c82-f041-4fa3-b233-eef1dfcbd777", "content-length": "41", "date": "Mon, 09 Sep 2024 17:52:55 GMT"} })
26292024-09-09T17:52:55.503ZDEBGnexus (producer-registration-task): registered with nexus successfully
26302024-09-09T17:52:55.503ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
26312024-09-09T17:52:56.137ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26322024-09-09T17:52:56.137ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26332024-09-09T17:52:56.140ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26342024-09-09T17:52:56.140ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26352024-09-09T17:52:56.142ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26362024-09-09T17:52:56.142ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26372024-09-09T17:52:56.144ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26382024-09-09T17:52:56.144ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26392024-09-09T17:52:56.145ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26402024-09-09T17:52:56.147ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
26412024-09-09T17:52:56.147ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26422024-09-09T17:52:56.147ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26432024-09-09T17:52:56.149ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26442024-09-09T17:52:56.151ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSessionList result = Ok(())
26452024-09-09T17:52:56.151ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26462024-09-09T17:52:56.151ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26472024-09-09T17:52:56.168ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 744350 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:61592 req_id = 787ee015-1112-4788-9835-aec5ddaab8fd response_code = 204 uri = /v1/login/recovery/local
26482024-09-09T17:52:56.207ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" } server_name = recovery.sys.oxide.test silo_id = 8dd86d6f-ad2d-45da-852c-8351c18c2cc5
26492024-09-09T17:52:56.215ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = 172.30.2.7:443 remote_addr = 10.151.1.100:34074
26502024-09-09T17:52:56.217ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26512024-09-09T17:52:56.217ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26522024-09-09T17:52:56.218ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26532024-09-09T17:52:56.219ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26542024-09-09T17:52:56.220ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26552024-09-09T17:52:56.221ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("token = \\"fa0231a0c9112e218dafc5bbb9e346846b4effe1\\"") } result = Ok(())
26562024-09-09T17:52:56.221ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26572024-09-09T17:52:56.221ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26582024-09-09T17:52:56.223ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26592024-09-09T17:52:56.223ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26602024-09-09T17:52:56.225ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26612024-09-09T17:52:56.225ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26622024-09-09T17:52:56.227ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26632024-09-09T17:52:56.227ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26642024-09-09T17:52:56.228ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26652024-09-09T17:52:56.229ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
26662024-09-09T17:52:56.229ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26672024-09-09T17:52:56.229ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26682024-09-09T17:52:56.231ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26692024-09-09T17:52:56.232ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("fa0231a0c9112e218dafc5bbb9e346846b4effe1") } result = Ok(())
26702024-09-09T17:52:56.232ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26712024-09-09T17:52:56.232ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26722024-09-09T17:52:56.247ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26732024-09-09T17:52:56.247ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26742024-09-09T17:52:56.249ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26752024-09-09T17:52:56.250ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26762024-09-09T17:52:56.251ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26772024-09-09T17:52:56.251ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26782024-09-09T17:52:56.252ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26792024-09-09T17:52:56.252ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26802024-09-09T17:52:56.254ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26812024-09-09T17:52:56.255ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
26822024-09-09T17:52:56.255ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26832024-09-09T17:52:56.255ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26842024-09-09T17:52:56.256ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26852024-09-09T17:52:56.256ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26862024-09-09T17:52:56.258ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26872024-09-09T17:52:56.258ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26882024-09-09T17:52:56.259ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26892024-09-09T17:52:56.260ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) } result = Ok(())
26902024-09-09T17:52:56.260ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:34074 req_id = b6798f3d-6645-4038-8420-285c4c521478 roles = RoleSet { roles: {} } uri = /v1/projects
26912024-09-09T17:52:56.260ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:34074 req_id = b6798f3d-6645-4038-8420-285c4c521478 resource = Database result = Ok(()) uri = /v1/projects
26922024-09-09T17:52:56.265ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:34074 req_id = b6798f3d-6645-4038-8420-285c4c521478 roles = RoleSet { roles: {} } uri = /v1/projects
26932024-09-09T17:52:56.265ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:34074 req_id = b6798f3d-6645-4038-8420-285c4c521478 resource = Database result = Ok(()) uri = /v1/projects
26942024-09-09T17:52:56.276ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:34074 req_id = b6798f3d-6645-4038-8420-285c4c521478 roles = RoleSet { roles: {} } uri = /v1/projects
26952024-09-09T17:52:56.276ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:34074 req_id = b6798f3d-6645-4038-8420-285c4c521478 resource = Database result = Ok(()) uri = /v1/projects
26962024-09-09T17:52:56.286ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:34074 req_id = b6798f3d-6645-4038-8420-285c4c521478 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/projects
26972024-09-09T17:52:56.287ZDEBGnexus (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:34074 req_id = b6798f3d-6645-4038-8420-285c4c521478 resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) } result = Ok(()) uri = /v1/projects
26982024-09-09T17:52:56.287ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:34074 req_id = b6798f3d-6645-4038-8420-285c4c521478 roles = RoleSet { roles: {} } uri = /v1/projects
26992024-09-09T17:52:56.287ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:34074 req_id = b6798f3d-6645-4038-8420-285c4c521478 resource = Database result = Ok(()) uri = /v1/projects
27002024-09-09T17:52:56.289ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 73969 local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:34074 req_id = b6798f3d-6645-4038-8420-285c4c521478 response_code = 200 uri = /v1/projects
27012024-09-09T17:52:56.294ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27022024-09-09T17:52:56.294ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27032024-09-09T17:52:56.296ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27042024-09-09T17:52:56.296ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27052024-09-09T17:52:56.297ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27062024-09-09T17:52:56.299ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("token = \\"fa0231a0c9112e218dafc5bbb9e346846b4effe1\\"") } result = Ok(())
27072024-09-09T17:52:56.299ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27082024-09-09T17:52:56.299ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27092024-09-09T17:52:56.307ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27102024-09-09T17:52:56.307ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27112024-09-09T17:52:56.309ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27122024-09-09T17:52:56.309ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27132024-09-09T17:52:56.310ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27142024-09-09T17:52:56.310ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27152024-09-09T17:52:56.312ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27162024-09-09T17:52:56.313ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
27172024-09-09T17:52:56.313ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27182024-09-09T17:52:56.313ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27192024-09-09T17:52:56.314ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27202024-09-09T17:52:56.315ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("fa0231a0c9112e218dafc5bbb9e346846b4effe1") } result = Ok(())
27212024-09-09T17:52:56.315ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27222024-09-09T17:52:56.315ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27232024-09-09T17:52:56.325ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27242024-09-09T17:52:56.325ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27252024-09-09T17:52:56.327ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27262024-09-09T17:52:56.327ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27272024-09-09T17:52:56.328ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27282024-09-09T17:52:56.328ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27292024-09-09T17:52:56.330ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27302024-09-09T17:52:56.330ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27312024-09-09T17:52:56.331ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27322024-09-09T17:52:56.332ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
27332024-09-09T17:52:56.332ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27342024-09-09T17:52:56.332ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27352024-09-09T17:52:56.333ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27362024-09-09T17:52:56.334ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27372024-09-09T17:52:56.335ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27382024-09-09T17:52:56.335ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27392024-09-09T17:52:56.336ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27402024-09-09T17:52:56.337ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) } result = Ok(())
27412024-09-09T17:52:56.337ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = abb7d00c-35e0-443d-91f7-334f0ff64d14 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
27422024-09-09T17:52:56.338ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = abb7d00c-35e0-443d-91f7-334f0ff64d14 resource = Database result = Ok(()) uri = /v1/system/ip-pools
27432024-09-09T17:52:56.347ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = abb7d00c-35e0-443d-91f7-334f0ff64d14 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
27442024-09-09T17:52:56.347ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = abb7d00c-35e0-443d-91f7-334f0ff64d14 resource = Database result = Ok(()) uri = /v1/system/ip-pools
27452024-09-09T17:52:56.349ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = abb7d00c-35e0-443d-91f7-334f0ff64d14 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/system/ip-pools
27462024-09-09T17:52:56.351ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = abb7d00c-35e0-443d-91f7-334f0ff64d14 resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools
27472024-09-09T17:52:56.351ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = abb7d00c-35e0-443d-91f7-334f0ff64d14 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
27482024-09-09T17:52:56.351ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = abb7d00c-35e0-443d-91f7-334f0ff64d14 resource = Database result = Ok(()) uri = /v1/system/ip-pools
27492024-09-09T17:52:56.355ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 60672 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = abb7d00c-35e0-443d-91f7-334f0ff64d14 response_code = 201 uri = /v1/system/ip-pools
27502024-09-09T17:52:56.360ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27512024-09-09T17:52:56.360ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27522024-09-09T17:52:56.362ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27532024-09-09T17:52:56.362ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27542024-09-09T17:52:56.363ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27552024-09-09T17:52:56.364ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("token = \\"fa0231a0c9112e218dafc5bbb9e346846b4effe1\\"") } result = Ok(())
27562024-09-09T17:52:56.364ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27572024-09-09T17:52:56.365ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27582024-09-09T17:52:56.366ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27592024-09-09T17:52:56.366ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27602024-09-09T17:52:56.367ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27612024-09-09T17:52:56.367ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27622024-09-09T17:52:56.368ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27632024-09-09T17:52:56.369ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27642024-09-09T17:52:56.370ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27652024-09-09T17:52:56.371ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
27662024-09-09T17:52:56.371ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27672024-09-09T17:52:56.371ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27682024-09-09T17:52:56.372ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27692024-09-09T17:52:56.373ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("fa0231a0c9112e218dafc5bbb9e346846b4effe1") } result = Ok(())
27702024-09-09T17:52:56.373ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27712024-09-09T17:52:56.374ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27722024-09-09T17:52:56.377ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27732024-09-09T17:52:56.377ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27742024-09-09T17:52:56.379ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27752024-09-09T17:52:56.379ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27762024-09-09T17:52:56.380ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27772024-09-09T17:52:56.380ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27782024-09-09T17:52:56.382ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27792024-09-09T17:52:56.382ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27802024-09-09T17:52:56.383ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27812024-09-09T17:52:56.384ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
27822024-09-09T17:52:56.384ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27832024-09-09T17:52:56.384ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27842024-09-09T17:52:56.385ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27852024-09-09T17:52:56.385ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27862024-09-09T17:52:56.386ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27872024-09-09T17:52:56.387ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27882024-09-09T17:52:56.388ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27892024-09-09T17:52:56.389ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) } result = Ok(())
27902024-09-09T17:52:56.389ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
27912024-09-09T17:52:56.389ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
27922024-09-09T17:52:56.391ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
27932024-09-09T17:52:56.391ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
27942024-09-09T17:52:56.404ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
27952024-09-09T17:52:56.404ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
27962024-09-09T17:52:56.407ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/system/ip-pools/default/silos
27972024-09-09T17:52:56.409ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e resource = IpPool { parent: Fleet, key: afa3d33b-557f-40cb-b51e-0752d1a96fdb, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
27982024-09-09T17:52:56.409ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
27992024-09-09T17:52:56.409ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
28002024-09-09T17:52:56.410ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
28012024-09-09T17:52:56.411ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
28022024-09-09T17:52:56.413ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
28032024-09-09T17:52:56.413ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
28042024-09-09T17:52:56.415ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
28052024-09-09T17:52:56.415ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
28062024-09-09T17:52:56.418ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
28072024-09-09T17:52:56.418ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
28082024-09-09T17:52:56.420ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/system/ip-pools/default/silos
28092024-09-09T17:52:56.421ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
28102024-09-09T17:52:56.421ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
28112024-09-09T17:52:56.421ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
28122024-09-09T17:52:56.423ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
28132024-09-09T17:52:56.423ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
28142024-09-09T17:52:56.425ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/system/ip-pools/default/silos
28152024-09-09T17:52:56.427ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools/default/silos
28162024-09-09T17:52:56.427ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
28172024-09-09T17:52:56.427ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
28182024-09-09T17:52:56.453ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:51252
28192024-09-09T17:52:56.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51252 req_id = c5a5ee86-a141-43d6-baeb-96af1d36c737 roles = RoleSet { roles: {} } uri = /metrics/producers
28202024-09-09T17:52:56.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51252 req_id = c5a5ee86-a141-43d6-baeb-96af1d36c737 resource = Database result = Ok(()) uri = /metrics/producers
28212024-09-09T17:52:56.474ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 114851 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = e784fad4-e766-444f-a027-314919ca278e response_code = 201 uri = /v1/system/ip-pools/default/silos
28222024-09-09T17:52:56.476ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28232024-09-09T17:52:56.476ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28242024-09-09T17:52:56.478ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28252024-09-09T17:52:56.478ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28262024-09-09T17:52:56.479ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28272024-09-09T17:52:56.480ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("token = \\"fa0231a0c9112e218dafc5bbb9e346846b4effe1\\"") } result = Ok(())
28282024-09-09T17:52:56.480ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28292024-09-09T17:52:56.480ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28302024-09-09T17:52:56.481ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28312024-09-09T17:52:56.481ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28322024-09-09T17:52:56.482ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28332024-09-09T17:52:56.483ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28342024-09-09T17:52:56.489ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
28352024-09-09T17:52:56.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51252 req_id = c5a5ee86-a141-43d6-baeb-96af1d36c737 roles = RoleSet { roles: {} } uri = /metrics/producers
28362024-09-09T17:52:56.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51252 req_id = c5a5ee86-a141-43d6-baeb-96af1d36c737 resource = Database result = Ok(()) uri = /metrics/producers
28372024-09-09T17:52:56.490ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28382024-09-09T17:52:56.491ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28392024-09-09T17:52:56.491ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28402024-09-09T17:52:56.493ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
28412024-09-09T17:52:56.493ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28422024-09-09T17:52:56.493ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28432024-09-09T17:52:56.494ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28442024-09-09T17:52:56.495ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("fa0231a0c9112e218dafc5bbb9e346846b4effe1") } result = Ok(())
28452024-09-09T17:52:56.495ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28462024-09-09T17:52:56.495ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28472024-09-09T17:52:56.499ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28482024-09-09T17:52:56.499ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28492024-09-09T17:52:56.501ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28502024-09-09T17:52:56.501ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28512024-09-09T17:52:56.503ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28522024-09-09T17:52:56.503ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28532024-09-09T17:52:56.504ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28542024-09-09T17:52:56.504ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28552024-09-09T17:52:56.505ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28562024-09-09T17:52:56.506ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
28572024-09-09T17:52:56.506ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28582024-09-09T17:52:56.506ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28592024-09-09T17:52:56.507ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28602024-09-09T17:52:56.508ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28612024-09-09T17:52:56.509ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28622024-09-09T17:52:56.509ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28632024-09-09T17:52:56.535ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
28642024-09-09T17:52:56.535ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "586e6d4b-b79c-430b-acd6-8f1a9bd6d0f9", "date": "Mon, 09 Sep 2024 17:52:56 GMT"} })
28652024-09-09T17:52:56.535ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 283b8781-e2cd-4d76-a776-70a483efe054
28662024-09-09T17:52:56.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 81921 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51252 req_id = c5a5ee86-a141-43d6-baeb-96af1d36c737 response_code = 201 uri = /metrics/producers
28672024-09-09T17:52:56.542ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28682024-09-09T17:52:56.543ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) } result = Ok(())
28692024-09-09T17:52:56.543ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
28702024-09-09T17:52:56.544ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
28712024-09-09T17:52:56.545ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
28722024-09-09T17:52:56.545ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
28732024-09-09T17:52:56.547ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
28742024-09-09T17:52:56.548ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
28752024-09-09T17:52:56.550ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
28762024-09-09T17:52:56.552ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f resource = IpPool { parent: Fleet, key: afa3d33b-557f-40cb-b51e-0752d1a96fdb, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
28772024-09-09T17:52:56.552ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
28782024-09-09T17:52:56.552ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
28792024-09-09T17:52:56.554ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
28802024-09-09T17:52:56.554ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
28812024-09-09T17:52:56.555ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
28822024-09-09T17:52:56.555ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
28832024-09-09T17:52:56.557ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
28842024-09-09T17:52:56.557ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
28852024-09-09T17:52:56.559ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
28862024-09-09T17:52:56.560ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f resource = IpPool { parent: Fleet, key: afa3d33b-557f-40cb-b51e-0752d1a96fdb, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
28872024-09-09T17:52:56.576ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 100313 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = d900d77f-fbb8-4143-a693-a2cc568f498f response_code = 201 uri = /v1/system/ip-pools/default/ranges/add
28882024-09-09T17:52:56.579ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28892024-09-09T17:52:56.579ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28902024-09-09T17:52:56.581ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28912024-09-09T17:52:56.581ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28922024-09-09T17:52:56.582ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28932024-09-09T17:52:56.583ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("token = \\"fa0231a0c9112e218dafc5bbb9e346846b4effe1\\"") } result = Ok(())
28942024-09-09T17:52:56.583ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28952024-09-09T17:52:56.583ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28962024-09-09T17:52:56.584ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28972024-09-09T17:52:56.585ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28982024-09-09T17:52:56.586ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28992024-09-09T17:52:56.586ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29002024-09-09T17:52:56.588ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29012024-09-09T17:52:56.588ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29022024-09-09T17:52:56.589ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29032024-09-09T17:52:56.590ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
29042024-09-09T17:52:56.590ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29052024-09-09T17:52:56.590ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29062024-09-09T17:52:56.592ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29072024-09-09T17:52:56.593ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("fa0231a0c9112e218dafc5bbb9e346846b4effe1") } result = Ok(())
29082024-09-09T17:52:56.593ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29092024-09-09T17:52:56.593ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29102024-09-09T17:52:56.596ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29112024-09-09T17:52:56.596ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29122024-09-09T17:52:56.597ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29132024-09-09T17:52:56.598ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29142024-09-09T17:52:56.599ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29152024-09-09T17:52:56.599ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29162024-09-09T17:52:56.600ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29172024-09-09T17:52:56.600ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29182024-09-09T17:52:56.601ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29192024-09-09T17:52:56.603ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
29202024-09-09T17:52:56.603ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29212024-09-09T17:52:56.603ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29222024-09-09T17:52:56.604ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29232024-09-09T17:52:56.604ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29242024-09-09T17:52:56.605ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29252024-09-09T17:52:56.605ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29262024-09-09T17:52:56.606ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29272024-09-09T17:52:56.608ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) } result = Ok(())
29282024-09-09T17:52:56.608ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
29292024-09-09T17:52:56.608ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
29302024-09-09T17:52:56.609ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
29312024-09-09T17:52:56.610ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
29322024-09-09T17:52:56.612ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
29332024-09-09T17:52:56.612ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
29342024-09-09T17:52:56.614ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
29352024-09-09T17:52:56.614ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
29362024-09-09T17:52:56.616ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/system/silos/recovery/quotas
29372024-09-09T17:52:56.617ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
29382024-09-09T17:52:56.617ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
29392024-09-09T17:52:56.617ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
29402024-09-09T17:52:56.619ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
29412024-09-09T17:52:56.619ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
29422024-09-09T17:52:56.622ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
29432024-09-09T17:52:56.622ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
29442024-09-09T17:52:56.624ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/system/silos/recovery/quotas
29452024-09-09T17:52:56.625ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
29462024-09-09T17:52:56.625ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
29472024-09-09T17:52:56.625ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
29482024-09-09T17:52:56.629ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 49783 local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:34074 req_id = 4ad01205-fda9-4f6e-a18c-5d591e22cf4f response_code = 200 uri = /v1/system/silos/recovery/quotas
29492024-09-09T17:52:56.632ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29502024-09-09T17:52:56.633ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29512024-09-09T17:52:56.633ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29522024-09-09T17:52:56.633ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29532024-09-09T17:52:56.635ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29542024-09-09T17:52:56.636ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("token = \\"fa0231a0c9112e218dafc5bbb9e346846b4effe1\\"") } result = Ok(())
29552024-09-09T17:52:56.636ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29562024-09-09T17:52:56.636ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29572024-09-09T17:52:56.637ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29582024-09-09T17:52:56.637ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29592024-09-09T17:52:56.638ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29602024-09-09T17:52:56.639ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29612024-09-09T17:52:56.640ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29622024-09-09T17:52:56.640ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29632024-09-09T17:52:56.641ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29642024-09-09T17:52:56.642ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
29652024-09-09T17:52:56.642ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29662024-09-09T17:52:56.642ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29672024-09-09T17:52:56.643ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29682024-09-09T17:52:56.644ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("fa0231a0c9112e218dafc5bbb9e346846b4effe1") } result = Ok(())
29692024-09-09T17:52:56.644ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29702024-09-09T17:52:56.645ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29712024-09-09T17:52:56.649ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29722024-09-09T17:52:56.649ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29732024-09-09T17:52:56.650ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29742024-09-09T17:52:56.650ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29752024-09-09T17:52:56.652ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29762024-09-09T17:52:56.652ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29772024-09-09T17:52:56.653ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29782024-09-09T17:52:56.653ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29792024-09-09T17:52:56.654ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29802024-09-09T17:52:56.655ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
29812024-09-09T17:52:56.655ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29822024-09-09T17:52:56.655ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29832024-09-09T17:52:56.656ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29842024-09-09T17:52:56.656ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29852024-09-09T17:52:56.658ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29862024-09-09T17:52:56.658ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29872024-09-09T17:52:56.659ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29882024-09-09T17:52:56.660ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) } result = Ok(())
29892024-09-09T17:52:56.660ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 58ed7780-67b7-4c07-a0be-0d1e011038d5 roles = RoleSet { roles: {} } uri = /v1/projects
29902024-09-09T17:52:56.660ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 58ed7780-67b7-4c07-a0be-0d1e011038d5 resource = Database result = Ok(()) uri = /v1/projects
29912024-09-09T17:52:56.662ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 58ed7780-67b7-4c07-a0be-0d1e011038d5 roles = RoleSet { roles: {} } uri = /v1/projects
29922024-09-09T17:52:56.663ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 58ed7780-67b7-4c07-a0be-0d1e011038d5 resource = Database result = Ok(()) uri = /v1/projects
29932024-09-09T17:52:56.665ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 58ed7780-67b7-4c07-a0be-0d1e011038d5 roles = RoleSet { roles: {} } uri = /v1/projects
29942024-09-09T17:52:56.665ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 58ed7780-67b7-4c07-a0be-0d1e011038d5 resource = Database result = Ok(()) uri = /v1/projects
29952024-09-09T17:52:56.667ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 58ed7780-67b7-4c07-a0be-0d1e011038d5 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/projects
29962024-09-09T17:52:56.669ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 58ed7780-67b7-4c07-a0be-0d1e011038d5 resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) } result = Ok(()) uri = /v1/projects
29972024-09-09T17:52:56.671ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create
29982024-09-09T17:52:56.671ZINFOnexus (SEC): saga create dag = {"end_node":17,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[2,3,null],[14,15,null],[16,0,null],[15,17,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","lookup_type":{"ById":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5"},"parent":null},"project_create":{"description":"","name":"proj-2453ac515eb"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","silo_user_id":"0ee810e3-4a9a-4652-8bce-cc10884fa144"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"project-create","start_node":16} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
29992024-09-09T17:52:56.671ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create
30002024-09-09T17:52:56.713ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create
30012024-09-09T17:52:56.713ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30022024-09-09T17:52:56.713ZDEBGnexus (SEC): saga log event new_state = N016 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30032024-09-09T17:52:56.713ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 16 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30042024-09-09T17:52:56.727ZDEBGnexus (SEC): saga log event new_state = N016 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30052024-09-09T17:52:56.727ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 16 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30062024-09-09T17:52:56.732ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30072024-09-09T17:52:56.732ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30082024-09-09T17:52:56.751ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = ProjectCreateRecord
30092024-09-09T17:52:56.751ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = ProjectCreateRecord
30102024-09-09T17:52:56.753ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = ProjectCreateRecord
30112024-09-09T17:52:56.754ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = ProjectCreateRecord
30122024-09-09T17:52:56.756ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = ProjectCreateRecord
30132024-09-09T17:52:56.756ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = ProjectCreateRecord
30142024-09-09T17:52:56.759ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = ProjectCreateRecord
30152024-09-09T17:52:56.760ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) } result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = ProjectCreateRecord
30162024-09-09T17:52:56.760ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = ProjectCreateRecord
30172024-09-09T17:52:56.760ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = ProjectCreateRecord
30182024-09-09T17:52:56.773ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30192024-09-09T17:52:56.773ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "lookup_type": Object {"ByName": String("proj-2453ac515eb")}, "parent": Object {"key": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "lookup_type": Object {"ById": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "name": String("proj-2453ac515eb"), "time_created": String("2024-09-09T17:52:56.751230Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:56.751230Z")}, "rcgen": Number(1), "silo_id": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}]) node_id = 0 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30202024-09-09T17:52:56.777ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30212024-09-09T17:52:56.777ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30222024-09-09T17:52:56.788ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30232024-09-09T17:52:56.788ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "lookup_type": Object {"ByName": String("proj-2453ac515eb")}, "parent": Object {"key": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "lookup_type": Object {"ById": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "silo_user_id": String("0ee810e3-4a9a-4652-8bce-cc10884fa144")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd28:352f:a6d3::/48"), "name": String("default")}}) node_id = 1 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30242024-09-09T17:52:56.799ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30252024-09-09T17:52:56.799ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30262024-09-09T17:52:56.802ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30272024-09-09T17:52:56.802ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30282024-09-09T17:52:56.805ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30292024-09-09T17:52:56.805ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30302024-09-09T17:52:56.810ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30312024-09-09T17:52:56.810ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("5f83af01-72d6-4899-931a-3a1a6d862c47")) node_id = 3 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30322024-09-09T17:52:56.814ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30332024-09-09T17:52:56.814ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30342024-09-09T17:52:56.817ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30352024-09-09T17:52:56.817ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("15758aff-f88a-49fb-ae8e-b5a97ab40fbf")) node_id = 4 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30362024-09-09T17:52:56.821ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30372024-09-09T17:52:56.821ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30382024-09-09T17:52:56.823ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30392024-09-09T17:52:56.823ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("e58187ad-6d92-447f-8e88-9ef4a307f7c1")) node_id = 5 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30402024-09-09T17:52:56.827ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30412024-09-09T17:52:56.827ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30422024-09-09T17:52:56.830ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30432024-09-09T17:52:56.830ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("be7fd0d9-15d5-4b89-ae1b-72434c67399b")) node_id = 6 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30442024-09-09T17:52:56.833ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30452024-09-09T17:52:56.833ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30462024-09-09T17:52:56.840ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30472024-09-09T17:52:56.840ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("63b7b3bf-beb3-442f-8213-2b78d33de13e")) node_id = 7 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30482024-09-09T17:52:56.845ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30492024-09-09T17:52:56.845ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30502024-09-09T17:52:56.851ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateVpc
30512024-09-09T17:52:56.852ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateVpc
30522024-09-09T17:52:56.854ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateVpc
30532024-09-09T17:52:56.854ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateVpc
30542024-09-09T17:52:56.856ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateVpc
30552024-09-09T17:52:56.856ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateVpc
30562024-09-09T17:52:56.859ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateVpc
30572024-09-09T17:52:56.859ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateVpc
30582024-09-09T17:52:56.861ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateVpc
30592024-09-09T17:52:56.863ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ByName("proj-2453ac515eb") } result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateVpc
30602024-09-09T17:52:56.863ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateVpc
30612024-09-09T17:52:56.863ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateVpc
30622024-09-09T17:52:56.886ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30632024-09-09T17:52:56.886ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("5f83af01-72d6-4899-931a-3a1a6d862c47"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "lookup_type": Object {"ByName": String("proj-2453ac515eb")}, "parent": Object {"key": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "lookup_type": Object {"ById": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("5f83af01-72d6-4899-931a-3a1a6d862c47"), "name": String("default"), "time_created": String("2024-09-09T17:52:56.851872Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:56.851872Z")}, "ipv6_prefix": String("fd28:352f:a6d3::/48"), "project_id": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "subnet_gen": Number(1), "system_router_id": String("15758aff-f88a-49fb-ae8e-b5a97ab40fbf"), "vni": Number(15487131)}]) node_id = 8 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30642024-09-09T17:52:56.893ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30652024-09-09T17:52:56.893ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30662024-09-09T17:52:56.900ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateRouter
30672024-09-09T17:52:56.900ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateRouter
30682024-09-09T17:52:56.902ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateRouter
30692024-09-09T17:52:56.902ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateRouter
30702024-09-09T17:52:56.904ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateRouter
30712024-09-09T17:52:56.905ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateRouter
30722024-09-09T17:52:56.907ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateRouter
30732024-09-09T17:52:56.907ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateRouter
30742024-09-09T17:52:56.909ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateRouter
30752024-09-09T17:52:56.912ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ByName("proj-2453ac515eb") }, key: 5f83af01-72d6-4899-931a-3a1a6d862c47, lookup_type: ByName("default") } result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateRouter
30762024-09-09T17:52:56.912ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateRouter
30772024-09-09T17:52:56.912ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateRouter
30782024-09-09T17:52:56.944ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30792024-09-09T17:52:56.944ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("15758aff-f88a-49fb-ae8e-b5a97ab40fbf"), "lookup_type": Object {"ById": String("15758aff-f88a-49fb-ae8e-b5a97ab40fbf")}, "parent": Object {"key": String("5f83af01-72d6-4899-931a-3a1a6d862c47"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "lookup_type": Object {"ByName": String("proj-2453ac515eb")}, "parent": Object {"key": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "lookup_type": Object {"ById": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}, "parent": Null}}}}) node_id = 9 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30802024-09-09T17:52:56.949ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30812024-09-09T17:52:56.949ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30822024-09-09T17:52:56.954ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV4Route
30832024-09-09T17:52:56.954ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV4Route
30842024-09-09T17:52:56.957ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV4Route
30852024-09-09T17:52:56.957ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV4Route
30862024-09-09T17:52:56.959ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV4Route
30872024-09-09T17:52:56.959ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV4Route
30882024-09-09T17:52:56.962ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV4Route
30892024-09-09T17:52:56.962ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV4Route
30902024-09-09T17:52:56.964ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV4Route
30912024-09-09T17:52:56.967ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ByName("proj-2453ac515eb") }, key: 5f83af01-72d6-4899-931a-3a1a6d862c47, lookup_type: ByName("default") }, key: 15758aff-f88a-49fb-ae8e-b5a97ab40fbf, lookup_type: ById(15758aff-f88a-49fb-ae8e-b5a97ab40fbf) } result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV4Route
30922024-09-09T17:52:56.967ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV4Route
30932024-09-09T17:52:56.967ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV4Route
30942024-09-09T17:52:57.000ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30952024-09-09T17:52:57.000ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30962024-09-09T17:52:57.006ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
30972024-09-09T17:52:57.006ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
30982024-09-09T17:52:57.011ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV6Route
30992024-09-09T17:52:57.012ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV6Route
31002024-09-09T17:52:57.014ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV6Route
31012024-09-09T17:52:57.014ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV6Route
31022024-09-09T17:52:57.017ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV6Route
31032024-09-09T17:52:57.017ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV6Route
31042024-09-09T17:52:57.018ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV6Route
31052024-09-09T17:52:57.019ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV6Route
31062024-09-09T17:52:57.021ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV6Route
31072024-09-09T17:52:57.024ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ByName("proj-2453ac515eb") }, key: 5f83af01-72d6-4899-931a-3a1a6d862c47, lookup_type: ByName("default") }, key: 15758aff-f88a-49fb-ae8e-b5a97ab40fbf, lookup_type: ById(15758aff-f88a-49fb-ae8e-b5a97ab40fbf) } result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV6Route
31082024-09-09T17:52:57.024ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV6Route
31092024-09-09T17:52:57.024ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateV6Route
31102024-09-09T17:52:57.065ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
31112024-09-09T17:52:57.065ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
31122024-09-09T17:52:57.069ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
31132024-09-09T17:52:57.069ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
31142024-09-09T17:52:57.072ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateSubnet
31152024-09-09T17:52:57.073ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateSubnet
31162024-09-09T17:52:57.074ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateSubnet
31172024-09-09T17:52:57.075ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateSubnet
31182024-09-09T17:52:57.077ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateSubnet
31192024-09-09T17:52:57.077ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateSubnet
31202024-09-09T17:52:57.079ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateSubnet
31212024-09-09T17:52:57.080ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateSubnet
31222024-09-09T17:52:57.082ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateSubnet
31232024-09-09T17:52:57.084ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ByName("proj-2453ac515eb") }, key: 5f83af01-72d6-4899-931a-3a1a6d862c47, lookup_type: ByName("default") } result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateSubnet
31242024-09-09T17:52:57.089ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateSubnet
31252024-09-09T17:52:57.089ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateSubnet
31262024-09-09T17:52:57.101ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateSubnet
31272024-09-09T17:52:57.101ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcCreateSubnet
31282024-09-09T17:52:57.105ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
31292024-09-09T17:52:57.105ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("63b7b3bf-beb3-442f-8213-2b78d33de13e"), "lookup_type": Object {"ById": String("63b7b3bf-beb3-442f-8213-2b78d33de13e")}, "parent": Object {"key": String("5f83af01-72d6-4899-931a-3a1a6d862c47"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "lookup_type": Object {"ByName": String("proj-2453ac515eb")}, "parent": Object {"key": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "lookup_type": Object {"ById": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("63b7b3bf-beb3-442f-8213-2b78d33de13e"), "name": String("default"), "time_created": String("2024-09-09T17:52:57.072944Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.072944Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd28:352f:a6d3::/64"), "rcgen": Number(1), "vpc_id": String("5f83af01-72d6-4899-931a-3a1a6d862c47")}]) node_id = 12 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
31302024-09-09T17:52:57.108ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
31312024-09-09T17:52:57.109ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
31322024-09-09T17:52:57.115ZDEBGnexus: default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: d171193c-2407-4a0c-a035-0c3927bdf548, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2024-09-09T17:52:57.114441917Z, time_modified: 2024-09-09T17:52:57.114441917Z, time_deleted: None }, vpc_id: 5f83af01-72d6-4899-931a-3a1a6d862c47, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 4b40924c-a740-49f4-a00d-eacbf23d814d, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2024-09-09T17:52:57.115057490Z, time_modified: 2024-09-09T17:52:57.115057490Z, time_deleted: None }, vpc_id: 5f83af01-72d6-4899-931a-3a1a6d862c47, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 8b238a63-79a3-4941-87f5-c1907830fd1b, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2024-09-09T17:52:57.115060460Z, time_modified: 2024-09-09T17:52:57.115060460Z, time_deleted: None }, vpc_id: 5f83af01-72d6-4899-931a-3a1a6d862c47, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
31332024-09-09T17:52:57.115ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcUpdateFirewall
31342024-09-09T17:52:57.115ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcUpdateFirewall
31352024-09-09T17:52:57.117ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcUpdateFirewall
31362024-09-09T17:52:57.117ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcUpdateFirewall
31372024-09-09T17:52:57.119ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcUpdateFirewall
31382024-09-09T17:52:57.119ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcUpdateFirewall
31392024-09-09T17:52:57.121ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcUpdateFirewall
31402024-09-09T17:52:57.122ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcUpdateFirewall
31412024-09-09T17:52:57.124ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcUpdateFirewall
31422024-09-09T17:52:57.126ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ByName("proj-2453ac515eb") }, key: 5f83af01-72d6-4899-931a-3a1a6d862c47, lookup_type: ByName("default") } result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcUpdateFirewall
31432024-09-09T17:52:57.126ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcUpdateFirewall
31442024-09-09T17:52:57.127ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcUpdateFirewall
31452024-09-09T17:52:57.176ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
31462024-09-09T17:52:57.176ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("d171193c-2407-4a0c-a035-0c3927bdf548"), "name": String("allow-internal-inbound"), "time_created": String("2024-09-09T17:52:57.114441917Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.114441917Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5f83af01-72d6-4899-931a-3a1a6d862c47")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("4b40924c-a740-49f4-a00d-eacbf23d814d"), "name": String("allow-ssh"), "time_created": String("2024-09-09T17:52:57.115057490Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.115057490Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5f83af01-72d6-4899-931a-3a1a6d862c47")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("8b238a63-79a3-4941-87f5-c1907830fd1b"), "name": String("allow-icmp"), "time_created": String("2024-09-09T17:52:57.115060460Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.115060460Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5f83af01-72d6-4899-931a-3a1a6d862c47")}]) node_id = 13 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
31472024-09-09T17:52:57.180ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
31482024-09-09T17:52:57.180ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
31492024-09-09T17:52:57.183ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31502024-09-09T17:52:57.183ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31512024-09-09T17:52:57.185ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31522024-09-09T17:52:57.185ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31532024-09-09T17:52:57.186ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31542024-09-09T17:52:57.186ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31552024-09-09T17:52:57.188ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31562024-09-09T17:52:57.188ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31572024-09-09T17:52:57.190ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31582024-09-09T17:52:57.190ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31592024-09-09T17:52:57.191ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31602024-09-09T17:52:57.192ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31612024-09-09T17:52:57.194ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31622024-09-09T17:52:57.194ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31632024-09-09T17:52:57.196ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31642024-09-09T17:52:57.199ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ById(d34752cb-c5c0-447f-a1c6-cd1b028b290f) }, key: 5f83af01-72d6-4899-931a-3a1a6d862c47, lookup_type: ByName("default") } result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31652024-09-09T17:52:57.199ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31662024-09-09T17:52:57.199ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31672024-09-09T17:52:57.201ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31682024-09-09T17:52:57.201ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31692024-09-09T17:52:57.203ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31702024-09-09T17:52:57.203ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31712024-09-09T17:52:57.205ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31722024-09-09T17:52:57.205ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31732024-09-09T17:52:57.207ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31742024-09-09T17:52:57.209ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ById(d34752cb-c5c0-447f-a1c6-cd1b028b290f) }, key: 5f83af01-72d6-4899-931a-3a1a6d862c47, lookup_type: ByName("default") } result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31752024-09-09T17:52:57.209ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31762024-09-09T17:52:57.209ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_node = VpcNotifySleds
31772024-09-09T17:52:57.215ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
31782024-09-09T17:52:57.215ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = []
31792024-09-09T17:52:57.215ZDEBGnexus: resolved 0 rules for sleds
31802024-09-09T17:52:57.264ZDEBGnexus: resolved sleds for vpc default vpc_to_sled = []
31812024-09-09T17:52:57.264ZDEBGnexus: sending firewall rules to sled agents
31822024-09-09T17:52:57.264ZINFOnexus: updated firewall rules on 0 sleds file = nexus/networking/src/firewall_rules.rs:496
31832024-09-09T17:52:57.264ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
31842024-09-09T17:52:57.264ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
31852024-09-09T17:52:57.268ZDEBGnexus (SEC): saga log event new_state = N015 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
31862024-09-09T17:52:57.268ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 15 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
31872024-09-09T17:52:57.271ZDEBGnexus (SEC): saga log event new_state = N015 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
31882024-09-09T17:52:57.271ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 15 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
31892024-09-09T17:52:57.275ZDEBGnexus (SEC): saga log event new_state = N017 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
31902024-09-09T17:52:57.275ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 17 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
31912024-09-09T17:52:57.279ZDEBGnexus (SEC): saga log event new_state = N017 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
31922024-09-09T17:52:57.279ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 17 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
31932024-09-09T17:52:57.282ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
31942024-09-09T17:52:57.282ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9
31952024-09-09T17:52:57.324ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
31962024-09-09T17:52:57.324ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 754fc73c-8282-47b5-8a59-8b04c8096ae9 saga_name = project-create saga_result = SagaResult { saga_id: 754fc73c-8282-47b5-8a59-8b04c8096ae9, saga_log: SagaLog { saga_id: 754fc73c-8282-47b5-8a59-8b04c8096ae9, unwinding: false, events: [N016 started, N016 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N017 started, N017 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "lookup_type": Object {"ByName": String("proj-2453ac515eb")}, "parent": Object {"key": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "lookup_type": Object {"ById": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "name": String("proj-2453ac515eb"), "time_created": String("2024-09-09T17:52:56.751230Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:56.751230Z")}, "rcgen": Number(1), "silo_id": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "lookup_type": Object {"ByName": String("proj-2453ac515eb")}, "parent": Object {"key": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "lookup_type": Object {"ById": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "silo_user_id": String("0ee810e3-4a9a-4652-8bce-cc10884fa144")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd28:352f:a6d3::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("5f83af01-72d6-4899-931a-3a1a6d862c47")), 4: Succeeded(String("15758aff-f88a-49fb-ae8e-b5a97ab40fbf")), 5: Succeeded(String("e58187ad-6d92-447f-8e88-9ef4a307f7c1")), 6: Succeeded(String("be7fd0d9-15d5-4b89-ae1b-72434c67399b")), 7: Succeeded(String("63b7b3bf-beb3-442f-8213-2b78d33de13e")), 8: Succeeded(Array [Object {"key": String("5f83af01-72d6-4899-931a-3a1a6d862c47"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "lookup_type": Object {"ByName": String("proj-2453ac515eb")}, "parent": Object {"key": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "lookup_type": Object {"ById": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("5f83af01-72d6-4899-931a-3a1a6d862c47"), "name": String("default"), "time_created": String("2024-09-09T17:52:56.851872Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:56.851872Z")}, "ipv6_prefix": String("fd28:352f:a6d3::/48"), "project_id": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "subnet_gen": Number(1), "system_router_id": String("15758aff-f88a-49fb-ae8e-b5a97ab40fbf"), "vni": Number(15487131)}]), 9: Succeeded(Object {"key": String("15758aff-f88a-49fb-ae8e-b5a97ab40fbf"), "lookup_type": Object {"ById": String("15758aff-f88a-49fb-ae8e-b5a97ab40fbf")}, "parent": Object {"key": String("5f83af01-72d6-4899-931a-3a1a6d862c47"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "lookup_type": Object {"ByName": String("proj-2453ac515eb")}, "parent": Object {"key": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "lookup_type": Object {"ById": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}, "parent": Null}}}}), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Array [Object {"key": String("63b7b3bf-beb3-442f-8213-2b78d33de13e"), "lookup_type": Object {"ById": String("63b7b3bf-beb3-442f-8213-2b78d33de13e")}, "parent": Object {"key": String("5f83af01-72d6-4899-931a-3a1a6d862c47"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "lookup_type": Object {"ByName": String("proj-2453ac515eb")}, "parent": Object {"key": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "lookup_type": Object {"ById": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("63b7b3bf-beb3-442f-8213-2b78d33de13e"), "name": String("default"), "time_created": String("2024-09-09T17:52:57.072944Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.072944Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd28:352f:a6d3::/64"), "rcgen": Number(1), "vpc_id": String("5f83af01-72d6-4899-931a-3a1a6d862c47")}]), 13: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("d171193c-2407-4a0c-a035-0c3927bdf548"), "name": String("allow-internal-inbound"), "time_created": String("2024-09-09T17:52:57.114441917Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.114441917Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5f83af01-72d6-4899-931a-3a1a6d862c47")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("4b40924c-a740-49f4-a00d-eacbf23d814d"), "name": String("allow-ssh"), "time_created": String("2024-09-09T17:52:57.115057490Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.115057490Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5f83af01-72d6-4899-931a-3a1a6d862c47")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("8b238a63-79a3-4941-87f5-c1907830fd1b"), "name": String("allow-icmp"), "time_created": String("2024-09-09T17:52:57.115060460Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.115060460Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5f83af01-72d6-4899-931a-3a1a6d862c47")}]), 14: Succeeded(Null), 15: Succeeded(Null), 16: Succeeded(Null), 17: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_subnet_id": String("63b7b3bf-beb3-442f-8213-2b78d33de13e"), "default_v4_route_id": String("e58187ad-6d92-447f-8e88-9ef4a307f7c1"), "default_v6_route_id": String("be7fd0d9-15d5-4b89-ae1b-72434c67399b"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("d171193c-2407-4a0c-a035-0c3927bdf548"), "name": String("allow-internal-inbound"), "time_created": String("2024-09-09T17:52:57.114441917Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.114441917Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5f83af01-72d6-4899-931a-3a1a6d862c47")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("4b40924c-a740-49f4-a00d-eacbf23d814d"), "name": String("allow-ssh"), "time_created": String("2024-09-09T17:52:57.115057490Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.115057490Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5f83af01-72d6-4899-931a-3a1a6d862c47")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("8b238a63-79a3-4941-87f5-c1907830fd1b"), "name": String("allow-icmp"), "time_created": String("2024-09-09T17:52:57.115060460Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.115060460Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("5f83af01-72d6-4899-931a-3a1a6d862c47")}], "no_result": Null, "project": Array [Object {"key": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "lookup_type": Object {"ByName": String("proj-2453ac515eb")}, "parent": Object {"key": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "lookup_type": Object {"ById": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "name": String("proj-2453ac515eb"), "time_created": String("2024-09-09T17:52:56.751230Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:56.751230Z")}, "rcgen": Number(1), "silo_id": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}], "route4": Null, "route6": Null, "router": Object {"key": String("15758aff-f88a-49fb-ae8e-b5a97ab40fbf"), "lookup_type": Object {"ById": String("15758aff-f88a-49fb-ae8e-b5a97ab40fbf")}, "parent": Object {"key": String("5f83af01-72d6-4899-931a-3a1a6d862c47"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "lookup_type": Object {"ByName": String("proj-2453ac515eb")}, "parent": Object {"key": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "lookup_type": Object {"ById": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("63b7b3bf-beb3-442f-8213-2b78d33de13e"), "lookup_type": Object {"ById": String("63b7b3bf-beb3-442f-8213-2b78d33de13e")}, "parent": Object {"key": String("5f83af01-72d6-4899-931a-3a1a6d862c47"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "lookup_type": Object {"ByName": String("proj-2453ac515eb")}, "parent": Object {"key": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "lookup_type": Object {"ById": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("63b7b3bf-beb3-442f-8213-2b78d33de13e"), "name": String("default"), "time_created": String("2024-09-09T17:52:57.072944Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.072944Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd28:352f:a6d3::/64"), "rcgen": Number(1), "vpc_id": String("5f83af01-72d6-4899-931a-3a1a6d862c47")}], "system_router_id": String("15758aff-f88a-49fb-ae8e-b5a97ab40fbf"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "lookup_type": Object {"ByName": String("proj-2453ac515eb")}, "parent": Object {"key": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "lookup_type": Object {"ById": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "silo_user_id": String("0ee810e3-4a9a-4652-8bce-cc10884fa144")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd28:352f:a6d3::/48"), "name": String("default")}}, "vpc_id": String("5f83af01-72d6-4899-931a-3a1a6d862c47")} }) }
31972024-09-09T17:52:57.324ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 692745 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 58ed7780-67b7-4c07-a0be-0d1e011038d5 response_code = 201 uri = /v1/projects
31982024-09-09T17:52:57.329ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31992024-09-09T17:52:57.330ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32002024-09-09T17:52:57.332ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32012024-09-09T17:52:57.332ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32022024-09-09T17:52:57.334ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32032024-09-09T17:52:57.335ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("token = \\"fa0231a0c9112e218dafc5bbb9e346846b4effe1\\"") } result = Ok(())
32042024-09-09T17:52:57.335ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32052024-09-09T17:52:57.335ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32062024-09-09T17:52:57.337ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32072024-09-09T17:52:57.337ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32082024-09-09T17:52:57.338ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32092024-09-09T17:52:57.339ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32102024-09-09T17:52:57.340ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32112024-09-09T17:52:57.340ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32122024-09-09T17:52:57.341ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32132024-09-09T17:52:57.342ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
32142024-09-09T17:52:57.342ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32152024-09-09T17:52:57.343ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32162024-09-09T17:52:57.344ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32172024-09-09T17:52:57.345ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("fa0231a0c9112e218dafc5bbb9e346846b4effe1") } result = Ok(())
32182024-09-09T17:52:57.345ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32192024-09-09T17:52:57.345ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32202024-09-09T17:52:57.357ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32212024-09-09T17:52:57.357ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32222024-09-09T17:52:57.358ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32232024-09-09T17:52:57.358ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32242024-09-09T17:52:57.359ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32252024-09-09T17:52:57.360ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32262024-09-09T17:52:57.361ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32272024-09-09T17:52:57.361ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32282024-09-09T17:52:57.362ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32292024-09-09T17:52:57.364ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
32302024-09-09T17:52:57.364ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32312024-09-09T17:52:57.364ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32322024-09-09T17:52:57.365ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32332024-09-09T17:52:57.365ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32342024-09-09T17:52:57.366ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32352024-09-09T17:52:57.367ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32362024-09-09T17:52:57.367ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32372024-09-09T17:52:57.369ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) } result = Ok(())
32382024-09-09T17:52:57.369ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 18de8a9a-fdf9-4d45-83ed-9db547a03b9a roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-2453ac515eb
32392024-09-09T17:52:57.369ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 18de8a9a-fdf9-4d45-83ed-9db547a03b9a resource = Database result = Ok(()) uri = /v1/disks?project=proj-2453ac515eb
32402024-09-09T17:52:57.370ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 18de8a9a-fdf9-4d45-83ed-9db547a03b9a roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-2453ac515eb
32412024-09-09T17:52:57.370ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 18de8a9a-fdf9-4d45-83ed-9db547a03b9a resource = Database result = Ok(()) uri = /v1/disks?project=proj-2453ac515eb
32422024-09-09T17:52:57.372ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 18de8a9a-fdf9-4d45-83ed-9db547a03b9a roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-2453ac515eb
32432024-09-09T17:52:57.372ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 18de8a9a-fdf9-4d45-83ed-9db547a03b9a resource = Database result = Ok(()) uri = /v1/disks?project=proj-2453ac515eb
32442024-09-09T17:52:57.375ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 18de8a9a-fdf9-4d45-83ed-9db547a03b9a roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-2453ac515eb
32452024-09-09T17:52:57.375ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 18de8a9a-fdf9-4d45-83ed-9db547a03b9a resource = Database result = Ok(()) uri = /v1/disks?project=proj-2453ac515eb
32462024-09-09T17:52:57.377ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 18de8a9a-fdf9-4d45-83ed-9db547a03b9a roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-2453ac515eb
32472024-09-09T17:52:57.377ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 18de8a9a-fdf9-4d45-83ed-9db547a03b9a resource = Database result = Ok(()) uri = /v1/disks?project=proj-2453ac515eb
32482024-09-09T17:52:57.379ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 18de8a9a-fdf9-4d45-83ed-9db547a03b9a roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-2453ac515eb
32492024-09-09T17:52:57.379ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 18de8a9a-fdf9-4d45-83ed-9db547a03b9a resource = Database result = Ok(()) uri = /v1/disks?project=proj-2453ac515eb
32502024-09-09T17:52:57.381ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 18de8a9a-fdf9-4d45-83ed-9db547a03b9a roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/disks?project=proj-2453ac515eb
32512024-09-09T17:52:57.383ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 18de8a9a-fdf9-4d45-83ed-9db547a03b9a resource = Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ByName("proj-2453ac515eb") } result = Ok(()) uri = /v1/disks?project=proj-2453ac515eb
32522024-09-09T17:52:57.383ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create
32532024-09-09T17:52:57.383ZINFOnexus (SEC): saga create dag = {"end_node":10,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,0,null],[8,10,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateDiskId","name":"disk_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVolumeId","name":"volume_id"}},{"Action":{"action_name":"disk_create.create_disk_record","label":"CreateDiskRecord","name":"created_disk"}},{"Action":{"action_name":"disk_create.regions_alloc","label":"RegionsAlloc","name":"datasets_and_regions"}},{"Action":{"action_name":"disk_create.space_account","label":"SpaceAccount","name":"no_result"}},{"Action":{"action_name":"disk_create.regions_ensure_undo","label":"RegionsEnsureUndo","name":"regions_ensure_undo"}},{"Action":{"action_name":"disk_create.regions_ensure","label":"RegionsEnsure","name":"regions_ensure"}},{"Action":{"action_name":"disk_create.create_volume_record","label":"CreateVolumeRecord","name":"created_volume"}},{"Action":{"action_name":"disk_create.finalize_disk_record","label":"FinalizeDiskRecord","name":"disk_runtime"}},{"Start":{"params":{"create_params":{"description":"","disk_source":{"block_size":512,"type":"blank"},"name":"disk-974c6d4eba5","size":1073741824},"project_id":"d34752cb-c5c0-447f-a1c6-cd1b028b290f","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","silo_user_id":"0ee810e3-4a9a-4652-8bce-cc10884fa144"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"disk-create","start_node":9} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
32542024-09-09T17:52:57.383ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create
32552024-09-09T17:52:57.414ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create
32562024-09-09T17:52:57.414ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
32572024-09-09T17:52:57.414ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
32582024-09-09T17:52:57.414ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
32592024-09-09T17:52:57.418ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
32602024-09-09T17:52:57.418ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
32612024-09-09T17:52:57.421ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
32622024-09-09T17:52:57.421ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
32632024-09-09T17:52:57.424ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
32642024-09-09T17:52:57.424ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("683a497d-fc1b-40ec-8487-9cb23a994287")) node_id = 0 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
32652024-09-09T17:52:57.433ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
32662024-09-09T17:52:57.433ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
32672024-09-09T17:52:57.439ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
32682024-09-09T17:52:57.439ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("dffa91f7-cdbc-4634-8a92-b72c94973d92")) node_id = 1 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
32692024-09-09T17:52:57.450ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
32702024-09-09T17:52:57.450ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
32712024-09-09T17:52:57.454ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32722024-09-09T17:52:57.454ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32732024-09-09T17:52:57.455ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32742024-09-09T17:52:57.455ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32752024-09-09T17:52:57.460ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32762024-09-09T17:52:57.460ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32772024-09-09T17:52:57.462ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32782024-09-09T17:52:57.462ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32792024-09-09T17:52:57.464ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32802024-09-09T17:52:57.465ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32812024-09-09T17:52:57.467ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32822024-09-09T17:52:57.467ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32832024-09-09T17:52:57.469ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32842024-09-09T17:52:57.471ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ById(d34752cb-c5c0-447f-a1c6-cd1b028b290f) } result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32852024-09-09T17:52:57.471ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32862024-09-09T17:52:57.471ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32872024-09-09T17:52:57.474ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32882024-09-09T17:52:57.474ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32892024-09-09T17:52:57.477ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32902024-09-09T17:52:57.477ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32912024-09-09T17:52:57.479ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32922024-09-09T17:52:57.479ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32932024-09-09T17:52:57.482ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32942024-09-09T17:52:57.484ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ById(d34752cb-c5c0-447f-a1c6-cd1b028b290f) } result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32952024-09-09T17:52:57.484ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32962024-09-09T17:52:57.484ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = CreateDiskRecord
32972024-09-09T17:52:57.528ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
32982024-09-09T17:52:57.528ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("683a497d-fc1b-40ec-8487-9cb23a994287"), "name": String("disk-974c6d4eba5"), "time_created": String("2024-09-09T17:52:57.454513Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.454513Z")}, "pantry_address": Null, "project_id": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-09-09T17:52:57.454513Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}) node_id = 2 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
32992024-09-09T17:52:57.536ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
33002024-09-09T17:52:57.536ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
33012024-09-09T17:52:57.540ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = RegionsAlloc
33022024-09-09T17:52:57.540ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = RegionsAlloc
33032024-09-09T17:52:57.610ZINFOnexus (datastore): Allocated regions for volume datasets_and_regions = [(Dataset { identity: DatasetIdentity { id: 0d731515-3696-45fe-816a-2c2bf0393b4f, time_created: 2024-09-09T17:52:53.875756Z, time_modified: 2024-09-09T17:52:53.875756Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: f8e6d791-b5fc-4ef9-b2c8-37d1fd7dd299, ip: Some(fd00:1122:3344:101::18), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None }, Region { identity: RegionIdentity { id: 92b13cb6-940c-4b7e-8609-e24eca0b9e27, time_created: 2024-09-09T17:52:57.572741Z, time_modified: 2024-09-09T17:52:57.572741Z }, dataset_id: 0d731515-3696-45fe-816a-2c2bf0393b4f, volume_id: dffa91f7-cdbc-4634-8a92-b72c94973d92, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false }), (Dataset { identity: DatasetIdentity { id: 88cec213-8d41-4e46-aea3-2d037677a065, time_created: 2024-09-09T17:52:53.875755Z, time_modified: 2024-09-09T17:52:53.875755Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: e68e093e-0654-4278-a79f-9c234ab4cc35, ip: Some(fd00:1122:3344:101::12), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None }, Region { identity: RegionIdentity { id: 10a77954-416e-4415-88a6-48812aecf48b, time_created: 2024-09-09T17:52:57.572741Z, time_modified: 2024-09-09T17:52:57.572741Z }, dataset_id: 88cec213-8d41-4e46-aea3-2d037677a065, volume_id: dffa91f7-cdbc-4634-8a92-b72c94973d92, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false }), (Dataset { identity: DatasetIdentity { id: a4f04eb1-0d05-41b6-b3d2-1d063e4e900e, time_created: 2024-09-09T17:52:53.875756Z, time_modified: 2024-09-09T17:52:53.875756Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 2c079939-1543-4f7b-ab38-d421cbf95e07, ip: Some(fd00:1122:3344:101::19), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None }, Region { identity: RegionIdentity { id: ed3574bc-42be-43d8-be1d-092fe2eef57d, time_created: 2024-09-09T17:52:57.572741Z, time_modified: 2024-09-09T17:52:57.572741Z }, dataset_id: a4f04eb1-0d05-41b6-b3d2-1d063e4e900e, volume_id: dffa91f7-cdbc-4634-8a92-b72c94973d92, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false })] file = nexus/db-queries/src/db/datastore/region.rs:280 maybe_snapshot_id = None volume_id = dffa91f7-cdbc-4634-8a92-b72c94973d92
33042024-09-09T17:52:57.610ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
33052024-09-09T17:52:57.610ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Array [Object {"identity": Object {"id": String("0d731515-3696-45fe-816a-2c2bf0393b4f"), "time_created": String("2024-09-09T17:52:53.875756Z"), "time_modified": String("2024-09-09T17:52:53.875756Z")}, "ip": String("fd00:1122:3344:101::18"), "kind": String("Crucible"), "pool_id": String("f8e6d791-b5fc-4ef9-b2c8-37d1fd7dd299"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("0d731515-3696-45fe-816a-2c2bf0393b4f"), "extent_count": Number(16), "identity": Object {"id": String("92b13cb6-940c-4b7e-8609-e24eca0b9e27"), "time_created": String("2024-09-09T17:52:57.572741Z"), "time_modified": String("2024-09-09T17:52:57.572741Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}], Array [Object {"identity": Object {"id": String("88cec213-8d41-4e46-aea3-2d037677a065"), "time_created": String("2024-09-09T17:52:53.875755Z"), "time_modified": String("2024-09-09T17:52:53.875755Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("e68e093e-0654-4278-a79f-9c234ab4cc35"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("88cec213-8d41-4e46-aea3-2d037677a065"), "extent_count": Number(16), "identity": Object {"id": String("10a77954-416e-4415-88a6-48812aecf48b"), "time_created": String("2024-09-09T17:52:57.572741Z"), "time_modified": String("2024-09-09T17:52:57.572741Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}], Array [Object {"identity": Object {"id": String("a4f04eb1-0d05-41b6-b3d2-1d063e4e900e"), "time_created": String("2024-09-09T17:52:53.875756Z"), "time_modified": String("2024-09-09T17:52:53.875756Z")}, "ip": String("fd00:1122:3344:101::19"), "kind": String("Crucible"), "pool_id": String("2c079939-1543-4f7b-ab38-d421cbf95e07"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("a4f04eb1-0d05-41b6-b3d2-1d063e4e900e"), "extent_count": Number(16), "identity": Object {"id": String("ed3574bc-42be-43d8-be1d-092fe2eef57d"), "time_created": String("2024-09-09T17:52:57.572741Z"), "time_modified": String("2024-09-09T17:52:57.572741Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}]]) node_id = 3 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
33062024-09-09T17:52:57.614ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
33072024-09-09T17:52:57.614ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
33082024-09-09T17:52:57.617ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = SpaceAccount
33092024-09-09T17:52:57.617ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = SpaceAccount
33102024-09-09T17:52:57.637ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
33112024-09-09T17:52:57.637ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
33122024-09-09T17:52:57.640ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
33132024-09-09T17:52:57.640ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
33142024-09-09T17:52:57.644ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
33152024-09-09T17:52:57.644ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
33162024-09-09T17:52:57.647ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
33172024-09-09T17:52:57.647ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
33182024-09-09T17:52:57.673ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 270.368014ms dataset = 88cec213-8d41-4e46-aea3-2d037677a065 file = nexus/src/app/crucible.rs:230 region = 10a77954-416e-4415-88a6-48812aecf48b saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create
33192024-09-09T17:52:57.690ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 197.284435ms dataset = a4f04eb1-0d05-41b6-b3d2-1d063e4e900e file = nexus/src/app/crucible.rs:230 region = ed3574bc-42be-43d8-be1d-092fe2eef57d saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create
33202024-09-09T17:52:57.701ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 309.012944ms dataset = 0d731515-3696-45fe-816a-2c2bf0393b4f file = nexus/src/app/crucible.rs:230 region = 92b13cb6-940c-4b7e-8609-e24eca0b9e27 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create
33212024-09-09T17:52:57.895ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 545.792322ms dataset = a4f04eb1-0d05-41b6-b3d2-1d063e4e900e file = nexus/src/app/crucible.rs:230 region = ed3574bc-42be-43d8-be1d-092fe2eef57d saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create
33222024-09-09T17:52:57.950ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 545.762019ms dataset = 88cec213-8d41-4e46-aea3-2d037677a065 file = nexus/src/app/crucible.rs:230 region = 10a77954-416e-4415-88a6-48812aecf48b saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create
33232024-09-09T17:52:58.015ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 695.191159ms dataset = 0d731515-3696-45fe-816a-2c2bf0393b4f file = nexus/src/app/crucible.rs:230 region = 92b13cb6-940c-4b7e-8609-e24eca0b9e27 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create
33242024-09-09T17:52:58.726ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
33252024-09-09T17:52:58.726ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"683a497d-fc1b-40ec-8487-9cb23a994287\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"683a497d-fc1b-40ec-8487-9cb23a994287\\",\\"key\\":\\"SOG/ruLKvnkpRX3KKDpc4o+3mubmACMmuIy659+rkR4=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::19]:19000\\",\\"[fd00:1122:3344:101::12]:19000\\",\\"[fd00:1122:3344:101::18]:19000\\"]}}]}")) node_id = 6 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
33262024-09-09T17:52:58.730ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
33272024-09-09T17:52:58.730ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
33282024-09-09T17:52:58.740ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
33292024-09-09T17:52:58.740ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
33302024-09-09T17:52:58.743ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
33312024-09-09T17:52:58.743ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
33322024-09-09T17:52:58.747ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33332024-09-09T17:52:58.747ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33342024-09-09T17:52:58.750ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33352024-09-09T17:52:58.750ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33362024-09-09T17:52:58.751ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33372024-09-09T17:52:58.751ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33382024-09-09T17:52:58.753ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33392024-09-09T17:52:58.753ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33402024-09-09T17:52:58.755ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33412024-09-09T17:52:58.755ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33422024-09-09T17:52:58.758ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33432024-09-09T17:52:58.758ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33442024-09-09T17:52:58.760ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33452024-09-09T17:52:58.760ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33462024-09-09T17:52:58.763ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33472024-09-09T17:52:58.765ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ById(d34752cb-c5c0-447f-a1c6-cd1b028b290f) }, key: 683a497d-fc1b-40ec-8487-9cb23a994287, lookup_type: ById(683a497d-fc1b-40ec-8487-9cb23a994287) } result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33482024-09-09T17:52:58.765ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33492024-09-09T17:52:58.765ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33502024-09-09T17:52:58.767ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33512024-09-09T17:52:58.767ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33522024-09-09T17:52:58.769ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33532024-09-09T17:52:58.770ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33542024-09-09T17:52:58.772ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33552024-09-09T17:52:58.772ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33562024-09-09T17:52:58.774ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33572024-09-09T17:52:58.777ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ById(d34752cb-c5c0-447f-a1c6-cd1b028b290f) }, key: 683a497d-fc1b-40ec-8487-9cb23a994287, lookup_type: ById(683a497d-fc1b-40ec-8487-9cb23a994287) } result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33582024-09-09T17:52:58.777ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33592024-09-09T17:52:58.777ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_node = FinalizeDiskRecord
33602024-09-09T17:52:58.791ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
33612024-09-09T17:52:58.791ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
33622024-09-09T17:52:58.794ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
33632024-09-09T17:52:58.794ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
33642024-09-09T17:52:58.797ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
33652024-09-09T17:52:58.797ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
33662024-09-09T17:52:58.800ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
33672024-09-09T17:52:58.800ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650
33682024-09-09T17:52:58.807ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
33692024-09-09T17:52:58.807ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 0d851498-2cfe-4bb2-9ae4-078ce7a15650 saga_name = disk-create saga_result = SagaResult { saga_id: 0d851498-2cfe-4bb2-9ae4-078ce7a15650, saga_log: SagaLog { saga_id: 0d851498-2cfe-4bb2-9ae4-078ce7a15650, unwinding: false, events: [N009 started, N009 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N010 started, N010 succeeded], node_status: {0: Succeeded(String("683a497d-fc1b-40ec-8487-9cb23a994287")), 1: Succeeded(String("dffa91f7-cdbc-4634-8a92-b72c94973d92")), 2: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("683a497d-fc1b-40ec-8487-9cb23a994287"), "name": String("disk-974c6d4eba5"), "time_created": String("2024-09-09T17:52:57.454513Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.454513Z")}, "pantry_address": Null, "project_id": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-09-09T17:52:57.454513Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}), 3: Succeeded(Array [Array [Object {"identity": Object {"id": String("0d731515-3696-45fe-816a-2c2bf0393b4f"), "time_created": String("2024-09-09T17:52:53.875756Z"), "time_modified": String("2024-09-09T17:52:53.875756Z")}, "ip": String("fd00:1122:3344:101::18"), "kind": String("Crucible"), "pool_id": String("f8e6d791-b5fc-4ef9-b2c8-37d1fd7dd299"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("0d731515-3696-45fe-816a-2c2bf0393b4f"), "extent_count": Number(16), "identity": Object {"id": String("92b13cb6-940c-4b7e-8609-e24eca0b9e27"), "time_created": String("2024-09-09T17:52:57.572741Z"), "time_modified": String("2024-09-09T17:52:57.572741Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}], Array [Object {"identity": Object {"id": String("88cec213-8d41-4e46-aea3-2d037677a065"), "time_created": String("2024-09-09T17:52:53.875755Z"), "time_modified": String("2024-09-09T17:52:53.875755Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("e68e093e-0654-4278-a79f-9c234ab4cc35"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("88cec213-8d41-4e46-aea3-2d037677a065"), "extent_count": Number(16), "identity": Object {"id": String("10a77954-416e-4415-88a6-48812aecf48b"), "time_created": String("2024-09-09T17:52:57.572741Z"), "time_modified": String("2024-09-09T17:52:57.572741Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}], Array [Object {"identity": Object {"id": String("a4f04eb1-0d05-41b6-b3d2-1d063e4e900e"), "time_created": String("2024-09-09T17:52:53.875756Z"), "time_modified": String("2024-09-09T17:52:53.875756Z")}, "ip": String("fd00:1122:3344:101::19"), "kind": String("Crucible"), "pool_id": String("2c079939-1543-4f7b-ab38-d421cbf95e07"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("a4f04eb1-0d05-41b6-b3d2-1d063e4e900e"), "extent_count": Number(16), "identity": Object {"id": String("ed3574bc-42be-43d8-be1d-092fe2eef57d"), "time_created": String("2024-09-09T17:52:57.572741Z"), "time_modified": String("2024-09-09T17:52:57.572741Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}]]), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"683a497d-fc1b-40ec-8487-9cb23a994287\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"683a497d-fc1b-40ec-8487-9cb23a994287\\",\\"key\\":\\"SOG/ruLKvnkpRX3KKDpc4o+3mubmACMmuIy659+rkR4=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::19]:19000\\",\\"[fd00:1122:3344:101::12]:19000\\",\\"[fd00:1122:3344:101::18]:19000\\"]}}]}")), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"created_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("683a497d-fc1b-40ec-8487-9cb23a994287"), "name": String("disk-974c6d4eba5"), "time_created": String("2024-09-09T17:52:57.454513Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.454513Z")}, "pantry_address": Null, "project_id": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-09-09T17:52:57.454513Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}, "created_volume": Null, "datasets_and_regions": Array [Array [Object {"identity": Object {"id": String("0d731515-3696-45fe-816a-2c2bf0393b4f"), "time_created": String("2024-09-09T17:52:53.875756Z"), "time_modified": String("2024-09-09T17:52:53.875756Z")}, "ip": String("fd00:1122:3344:101::18"), "kind": String("Crucible"), "pool_id": String("f8e6d791-b5fc-4ef9-b2c8-37d1fd7dd299"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("0d731515-3696-45fe-816a-2c2bf0393b4f"), "extent_count": Number(16), "identity": Object {"id": String("92b13cb6-940c-4b7e-8609-e24eca0b9e27"), "time_created": String("2024-09-09T17:52:57.572741Z"), "time_modified": String("2024-09-09T17:52:57.572741Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}], Array [Object {"identity": Object {"id": String("88cec213-8d41-4e46-aea3-2d037677a065"), "time_created": String("2024-09-09T17:52:53.875755Z"), "time_modified": String("2024-09-09T17:52:53.875755Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("e68e093e-0654-4278-a79f-9c234ab4cc35"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("88cec213-8d41-4e46-aea3-2d037677a065"), "extent_count": Number(16), "identity": Object {"id": String("10a77954-416e-4415-88a6-48812aecf48b"), "time_created": String("2024-09-09T17:52:57.572741Z"), "time_modified": String("2024-09-09T17:52:57.572741Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}], Array [Object {"identity": Object {"id": String("a4f04eb1-0d05-41b6-b3d2-1d063e4e900e"), "time_created": String("2024-09-09T17:52:53.875756Z"), "time_modified": String("2024-09-09T17:52:53.875756Z")}, "ip": String("fd00:1122:3344:101::19"), "kind": String("Crucible"), "pool_id": String("2c079939-1543-4f7b-ab38-d421cbf95e07"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("a4f04eb1-0d05-41b6-b3d2-1d063e4e900e"), "extent_count": Number(16), "identity": Object {"id": String("ed3574bc-42be-43d8-be1d-092fe2eef57d"), "time_created": String("2024-09-09T17:52:57.572741Z"), "time_modified": String("2024-09-09T17:52:57.572741Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}]], "disk_id": String("683a497d-fc1b-40ec-8487-9cb23a994287"), "disk_runtime": Null, "no_result": Null, "regions_ensure": String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"683a497d-fc1b-40ec-8487-9cb23a994287\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"683a497d-fc1b-40ec-8487-9cb23a994287\\",\\"key\\":\\"SOG/ruLKvnkpRX3KKDpc4o+3mubmACMmuIy659+rkR4=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::19]:19000\\",\\"[fd00:1122:3344:101::12]:19000\\",\\"[fd00:1122:3344:101::18]:19000\\"]}}]}"), "regions_ensure_undo": Null, "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")} }) }
33702024-09-09T17:52:58.807ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1479262 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 18de8a9a-fdf9-4d45-83ed-9db547a03b9a response_code = 201 uri = /v1/disks?project=proj-2453ac515eb
33712024-09-09T17:52:58.811ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33722024-09-09T17:52:58.811ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33732024-09-09T17:52:58.812ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33742024-09-09T17:52:58.812ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33752024-09-09T17:52:58.813ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33762024-09-09T17:52:58.814ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("token = \\"fa0231a0c9112e218dafc5bbb9e346846b4effe1\\"") } result = Ok(())
33772024-09-09T17:52:58.814ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33782024-09-09T17:52:58.814ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33792024-09-09T17:52:58.816ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33802024-09-09T17:52:58.816ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33812024-09-09T17:52:58.817ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33822024-09-09T17:52:58.817ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33832024-09-09T17:52:58.818ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33842024-09-09T17:52:58.819ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33852024-09-09T17:52:58.820ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33862024-09-09T17:52:58.821ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
33872024-09-09T17:52:58.821ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33882024-09-09T17:52:58.821ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33892024-09-09T17:52:58.822ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33902024-09-09T17:52:58.823ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("fa0231a0c9112e218dafc5bbb9e346846b4effe1") } result = Ok(())
33912024-09-09T17:52:58.823ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33922024-09-09T17:52:58.823ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33932024-09-09T17:52:58.827ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33942024-09-09T17:52:58.827ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33952024-09-09T17:52:58.828ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33962024-09-09T17:52:58.829ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33972024-09-09T17:52:58.830ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33982024-09-09T17:52:58.830ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33992024-09-09T17:52:58.831ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34002024-09-09T17:52:58.832ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34012024-09-09T17:52:58.833ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34022024-09-09T17:52:58.834ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
34032024-09-09T17:52:58.834ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34042024-09-09T17:52:58.834ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34052024-09-09T17:52:58.836ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34062024-09-09T17:52:58.836ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34072024-09-09T17:52:58.837ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34082024-09-09T17:52:58.838ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34092024-09-09T17:52:58.839ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34102024-09-09T17:52:58.840ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) } result = Ok(())
34112024-09-09T17:52:58.840ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 roles = RoleSet { roles: {} } uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34122024-09-09T17:52:58.840ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 resource = Database result = Ok(()) uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34132024-09-09T17:52:58.842ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 roles = RoleSet { roles: {} } uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34142024-09-09T17:52:58.842ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 resource = Database result = Ok(()) uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34152024-09-09T17:52:58.843ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 roles = RoleSet { roles: {} } uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34162024-09-09T17:52:58.843ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 resource = Database result = Ok(()) uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34172024-09-09T17:52:58.846ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 roles = RoleSet { roles: {} } uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34182024-09-09T17:52:58.846ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 resource = Database result = Ok(()) uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34192024-09-09T17:52:58.848ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 roles = RoleSet { roles: {} } uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34202024-09-09T17:52:58.848ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 resource = Database result = Ok(()) uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34212024-09-09T17:52:58.851ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 roles = RoleSet { roles: {} } uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34222024-09-09T17:52:58.851ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 resource = Database result = Ok(()) uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34232024-09-09T17:52:58.853ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 roles = RoleSet { roles: {} } uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34242024-09-09T17:52:58.853ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 resource = Database result = Ok(()) uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34252024-09-09T17:52:58.857ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34262024-09-09T17:52:58.859ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ByName("proj-2453ac515eb") }, key: 683a497d-fc1b-40ec-8487-9cb23a994287, lookup_type: ByName("disk-974c6d4eba5") } result = Ok(()) uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34272024-09-09T17:52:58.859ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 roles = RoleSet { roles: {} } uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34282024-09-09T17:52:58.859ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 resource = Database result = Ok(()) uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34292024-09-09T17:52:58.861ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 roles = RoleSet { roles: {} } uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34302024-09-09T17:52:58.862ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 resource = Database result = Ok(()) uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34312024-09-09T17:52:58.863ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 roles = RoleSet { roles: {} } uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34322024-09-09T17:52:58.863ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 resource = Database result = Ok(()) uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34332024-09-09T17:52:58.865ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 roles = RoleSet { roles: {} } uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34342024-09-09T17:52:58.865ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 resource = Database result = Ok(()) uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34352024-09-09T17:52:58.867ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 roles = RoleSet { roles: {} } uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34362024-09-09T17:52:58.867ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 resource = Database result = Ok(()) uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34372024-09-09T17:52:58.869ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 roles = RoleSet { roles: {} } uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34382024-09-09T17:52:58.869ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 resource = Database result = Ok(()) uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34392024-09-09T17:52:58.871ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 roles = RoleSet { roles: {} } uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34402024-09-09T17:52:58.871ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 resource = Database result = Ok(()) uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34412024-09-09T17:52:58.874ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34422024-09-09T17:52:58.877ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ById(d34752cb-c5c0-447f-a1c6-cd1b028b290f) }, key: 683a497d-fc1b-40ec-8487-9cb23a994287, lookup_type: ById(683a497d-fc1b-40ec-8487-9cb23a994287) } result = Ok(()) uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
34432024-09-09T17:52:58.877ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4 saga_name = disk-delete
34442024-09-09T17:52:58.877ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[3,4,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","silo_user_id":"0ee810e3-4a9a-4652-8bce-cc10884fa144"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"dffa91f7-cdbc-4634-8a92-b72c94973d92"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"final_no_result"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"683a497d-fc1b-40ec-8487-9cb23a994287","project_id":"d34752cb-c5c0-447f-a1c6-cd1b028b290f","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","silo_user_id":"0ee810e3-4a9a-4652-8bce-cc10884fa144"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"dffa91f7-cdbc-4634-8a92-b72c94973d92"}}},"End"]},"saga_name":"disk-delete","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4 saga_name = disk-delete sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34452024-09-09T17:52:58.877ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4 saga_name = disk-delete
34462024-09-09T17:52:58.882ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4 saga_name = disk-delete
34472024-09-09T17:52:58.882ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4 saga_name = disk-delete sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34482024-09-09T17:52:58.882ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34492024-09-09T17:52:58.882ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34502024-09-09T17:52:58.887ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34512024-09-09T17:52:58.887ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34522024-09-09T17:52:58.891ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34532024-09-09T17:52:58.891ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34542024-09-09T17:52:58.906ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34552024-09-09T17:52:58.906ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("683a497d-fc1b-40ec-8487-9cb23a994287"), "name": String("disk-974c6d4eba5"), "time_created": String("2024-09-09T17:52:57.454513Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.454513Z")}, "pantry_address": Null, "project_id": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-09-09T17:52:58.765596Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}) node_id = 0 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34562024-09-09T17:52:58.911ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34572024-09-09T17:52:58.911ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34582024-09-09T17:52:58.915ZDEBGnexus (SagaExecutor): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true roles = RoleSet { roles: {} } saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4 saga_name = disk-delete saga_node = SpaceAccount
34592024-09-09T17:52:58.916ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true resource = Database result = Ok(()) saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4 saga_name = disk-delete saga_node = SpaceAccount
34602024-09-09T17:52:58.931ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34612024-09-09T17:52:58.931ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34622024-09-09T17:52:58.935ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34632024-09-09T17:52:58.935ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34642024-09-09T17:52:58.938ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34652024-09-09T17:52:58.938ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "silo_user_id": String("0ee810e3-4a9a-4652-8bce-cc10884fa144")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}) node_id = 2 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34662024-09-09T17:52:58.941ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34672024-09-09T17:52:58.941ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34682024-09-09T17:52:58.945ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34692024-09-09T17:52:58.945ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34702024-09-09T17:52:58.948ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34712024-09-09T17:52:58.948ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34722024-09-09T17:52:58.973ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34732024-09-09T17:52:58.973ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array []}}) node_id = 4 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34742024-09-09T17:52:58.976ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34752024-09-09T17:52:58.976ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34762024-09-09T17:52:58.979ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34772024-09-09T17:52:58.979ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34782024-09-09T17:52:58.982ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34792024-09-09T17:52:58.982ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34802024-09-09T17:52:58.985ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34812024-09-09T17:52:58.985ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34822024-09-09T17:52:58.988ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34832024-09-09T17:52:58.988ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34842024-09-09T17:52:58.991ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34852024-09-09T17:52:58.991ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34862024-09-09T17:52:58.995ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34872024-09-09T17:52:58.995ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34882024-09-09T17:52:58.997ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34892024-09-09T17:52:58.997ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34902024-09-09T17:52:59.001ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34912024-09-09T17:52:59.001ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
34922024-09-09T17:52:59.043ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 126.639364ms file = nexus/src/app/crucible.rs:827 region_id = 92b13cb6-940c-4b7e-8609-e24eca0b9e27 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4 saga_name = disk-delete
34932024-09-09T17:52:59.175ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = 92b13cb6-940c-4b7e-8609-e24eca0b9e27 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4 saga_name = disk-delete
34942024-09-09T17:52:59.228ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 81.871297ms file = nexus/src/app/crucible.rs:827 region_id = 10a77954-416e-4415-88a6-48812aecf48b saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4 saga_name = disk-delete
34952024-09-09T17:52:59.315ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = 10a77954-416e-4415-88a6-48812aecf48b saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4 saga_name = disk-delete
34962024-09-09T17:52:59.363ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 76.01014ms file = nexus/src/app/crucible.rs:827 region_id = ed3574bc-42be-43d8-be1d-092fe2eef57d saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4 saga_name = disk-delete
34972024-09-09T17:52:59.443ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = ed3574bc-42be-43d8-be1d-092fe2eef57d saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4 saga_name = disk-delete
34982024-09-09T17:52:59.464ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
34992024-09-09T17:52:59.465ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
35002024-09-09T17:52:59.468ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
35012024-09-09T17:52:59.468ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
35022024-09-09T17:52:59.476ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
35032024-09-09T17:52:59.476ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
35042024-09-09T17:52:59.480ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
35052024-09-09T17:52:59.480ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
35062024-09-09T17:52:59.483ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
35072024-09-09T17:52:59.483ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
35082024-09-09T17:52:59.486ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
35092024-09-09T17:52:59.487ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
35102024-09-09T17:52:59.489ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
35112024-09-09T17:52:59.489ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
35122024-09-09T17:52:59.492ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4 sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
35132024-09-09T17:52:59.492ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4
35142024-09-09T17:52:59.500ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4 saga_name = disk-delete sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
35152024-09-09T17:52:59.500ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = eca1b925-c8bc-43fc-882a-0edb35ab4ee4 saga_name = disk-delete saga_result = SagaResult { saga_id: eca1b925-c8bc-43fc-882a-0edb35ab4ee4, saga_log: SagaLog { saga_id: eca1b925-c8bc-43fc-882a-0edb35ab4ee4, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N006 started, N005 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("683a497d-fc1b-40ec-8487-9cb23a994287"), "name": String("disk-974c6d4eba5"), "time_created": String("2024-09-09T17:52:57.454513Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.454513Z")}, "pantry_address": Null, "project_id": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-09-09T17:52:58.765596Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "silo_user_id": String("0ee810e3-4a9a-4652-8bce-cc10884fa144")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array []}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array []}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("683a497d-fc1b-40ec-8487-9cb23a994287"), "name": String("disk-974c6d4eba5"), "time_created": String("2024-09-09T17:52:57.454513Z"), "time_deleted": Null, "time_modified": String("2024-09-09T17:52:57.454513Z")}, "pantry_address": Null, "project_id": String("d34752cb-c5c0-447f-a1c6-cd1b028b290f"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-09-09T17:52:58.765596Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}, "final_no_result": Null, "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("8dd86d6f-ad2d-45da-852c-8351c18c2cc5"), "silo_user_id": String("0ee810e3-4a9a-4652-8bce-cc10884fa144")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("dffa91f7-cdbc-4634-8a92-b72c94973d92")}, "volume_delete_subsaga_no_result": Null} }) }
35162024-09-09T17:52:59.500ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 689912 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5a42c048-77e0-4fc6-9774-4064a8533922 response_code = 204 uri = /v1/disks/disk-974c6d4eba5?project=proj-2453ac515eb
35172024-09-09T17:52:59.504ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35182024-09-09T17:52:59.504ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35192024-09-09T17:52:59.505ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35202024-09-09T17:52:59.507ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = DeviceAuthRequestList result = Ok(())
35212024-09-09T17:52:59.507ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35222024-09-09T17:52:59.508ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35232024-09-09T17:52:59.518ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 16299 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 484a40d5-ad36-4b69-ab3a-1fe1377c2ad3 response_code = 200 uri = /device/auth
35242024-09-09T17:52:59.520ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35252024-09-09T17:52:59.520ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35262024-09-09T17:52:59.521ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35272024-09-09T17:52:59.521ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35282024-09-09T17:52:59.523ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35292024-09-09T17:52:59.524ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("token = \\"fa0231a0c9112e218dafc5bbb9e346846b4effe1\\"") } result = Ok(())
35302024-09-09T17:52:59.524ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35312024-09-09T17:52:59.524ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35322024-09-09T17:52:59.525ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35332024-09-09T17:52:59.526ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35342024-09-09T17:52:59.527ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35352024-09-09T17:52:59.527ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35362024-09-09T17:52:59.529ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35372024-09-09T17:52:59.529ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35382024-09-09T17:52:59.530ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35392024-09-09T17:52:59.531ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
35402024-09-09T17:52:59.531ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35412024-09-09T17:52:59.531ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35422024-09-09T17:52:59.533ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35432024-09-09T17:52:59.534ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("fa0231a0c9112e218dafc5bbb9e346846b4effe1") } result = Ok(())
35442024-09-09T17:52:59.534ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35452024-09-09T17:52:59.534ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35462024-09-09T17:52:59.538ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35472024-09-09T17:52:59.539ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35482024-09-09T17:52:59.541ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35492024-09-09T17:52:59.541ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35502024-09-09T17:52:59.545ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35512024-09-09T17:52:59.545ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35522024-09-09T17:52:59.546ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35532024-09-09T17:52:59.547ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35542024-09-09T17:52:59.548ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35552024-09-09T17:52:59.549ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
35562024-09-09T17:52:59.549ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35572024-09-09T17:52:59.550ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35582024-09-09T17:52:59.551ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35592024-09-09T17:52:59.551ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35602024-09-09T17:52:59.552ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35612024-09-09T17:52:59.553ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35622024-09-09T17:52:59.554ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35632024-09-09T17:52:59.555ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) } result = Ok(())
35642024-09-09T17:52:59.555ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {} } uri = /device/confirm
35652024-09-09T17:52:59.555ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = Database result = Ok(()) uri = /device/confirm
35662024-09-09T17:52:59.557ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {} } uri = /device/confirm
35672024-09-09T17:52:59.557ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = Database result = Ok(()) uri = /device/confirm
35682024-09-09T17:52:59.559ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {} } uri = /device/confirm
35692024-09-09T17:52:59.560ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = Database result = Ok(()) uri = /device/confirm
35702024-09-09T17:52:59.562ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /device/confirm
35712024-09-09T17:52:59.563ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = DeviceAuthRequest { parent: Fleet, key: "GKGX-LVGK", lookup_type: ByCompositeId("user_code = \\"GKGX-LVGK\\"") } result = Ok(()) uri = /device/confirm
35722024-09-09T17:52:59.563ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {} } uri = /device/confirm
35732024-09-09T17:52:59.563ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = Database result = Ok(()) uri = /device/confirm
35742024-09-09T17:52:59.564ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {} } uri = /device/confirm
35752024-09-09T17:52:59.564ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = Database result = Ok(()) uri = /device/confirm
35762024-09-09T17:52:59.566ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {} } uri = /device/confirm
35772024-09-09T17:52:59.566ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = Database result = Ok(()) uri = /device/confirm
35782024-09-09T17:52:59.568ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {} } uri = /device/confirm
35792024-09-09T17:52:59.568ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = Database result = Ok(()) uri = /device/confirm
35802024-09-09T17:52:59.570ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {} } uri = /device/confirm
35812024-09-09T17:52:59.570ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = Database result = Ok(()) uri = /device/confirm
35822024-09-09T17:52:59.572ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /device/confirm
35832024-09-09T17:52:59.573ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(()) uri = /device/confirm
35842024-09-09T17:52:59.574ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {} } uri = /device/confirm
35852024-09-09T17:52:59.574ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = Database result = Ok(()) uri = /device/confirm
35862024-09-09T17:52:59.576ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {} } uri = /device/confirm
35872024-09-09T17:52:59.577ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = Database result = Ok(()) uri = /device/confirm
35882024-09-09T17:52:59.579ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /device/confirm
35892024-09-09T17:52:59.580ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = DeviceAuthRequest { parent: Fleet, key: "GKGX-LVGK", lookup_type: ByCompositeId("user_code = \\"GKGX-LVGK\\"") } result = Ok(()) uri = /device/confirm
35902024-09-09T17:52:59.580ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {} } uri = /device/confirm
35912024-09-09T17:52:59.580ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = Database result = Ok(()) uri = /device/confirm
35922024-09-09T17:52:59.582ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {} } uri = /device/confirm
35932024-09-09T17:52:59.582ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = Database result = Ok(()) uri = /device/confirm
35942024-09-09T17:52:59.584ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {} } uri = /device/confirm
35952024-09-09T17:52:59.585ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = Database result = Ok(()) uri = /device/confirm
35962024-09-09T17:52:59.587ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /device/confirm
35972024-09-09T17:52:59.588ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(()) uri = /device/confirm
35982024-09-09T17:52:59.588ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 roles = RoleSet { roles: {} } uri = /device/confirm
35992024-09-09T17:52:59.588ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 resource = Database result = Ok(()) uri = /device/confirm
36002024-09-09T17:52:59.630ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 110468 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = 6a890857-672a-4dc4-8d28-a6b534c27a12 response_code = 204 uri = /device/confirm
36012024-09-09T17:52:59.631ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36022024-09-09T17:52:59.631ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36032024-09-09T17:52:59.642ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 11103 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:34074 req_id = fff5c610-eab7-4f4d-a5a4-16ad86b90175 response_code = 200 uri = /device/token
36042024-09-09T17:52:59.646ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36052024-09-09T17:52:59.646ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36062024-09-09T17:52:59.647ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36072024-09-09T17:52:59.647ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36082024-09-09T17:52:59.649ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
36092024-09-09T17:52:59.651ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("token = \\"fa0231a0c9112e218dafc5bbb9e346846b4effe1\\"") } result = Ok(())
36102024-09-09T17:52:59.651ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36112024-09-09T17:52:59.651ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36122024-09-09T17:52:59.652ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36132024-09-09T17:52:59.652ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36142024-09-09T17:52:59.654ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36152024-09-09T17:52:59.654ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36162024-09-09T17:52:59.655ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36172024-09-09T17:52:59.656ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36182024-09-09T17:52:59.657ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
36192024-09-09T17:52:59.658ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
36202024-09-09T17:52:59.658ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36212024-09-09T17:52:59.658ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36222024-09-09T17:52:59.659ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
36232024-09-09T17:52:59.660ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("fa0231a0c9112e218dafc5bbb9e346846b4effe1") } result = Ok(())
36242024-09-09T17:52:59.660ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36252024-09-09T17:52:59.660ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36262024-09-09T17:52:59.665ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36272024-09-09T17:52:59.665ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36282024-09-09T17:52:59.667ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36292024-09-09T17:52:59.667ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36302024-09-09T17:52:59.668ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36312024-09-09T17:52:59.668ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36322024-09-09T17:52:59.669ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36332024-09-09T17:52:59.669ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36342024-09-09T17:52:59.671ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
36352024-09-09T17:52:59.672ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
36362024-09-09T17:52:59.672ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36372024-09-09T17:52:59.672ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36382024-09-09T17:52:59.673ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36392024-09-09T17:52:59.673ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36402024-09-09T17:52:59.675ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36412024-09-09T17:52:59.675ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36422024-09-09T17:52:59.676ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
36432024-09-09T17:52:59.677ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) } result = Ok(())
36442024-09-09T17:52:59.677ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36452024-09-09T17:52:59.678ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36462024-09-09T17:52:59.679ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36472024-09-09T17:52:59.679ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36482024-09-09T17:52:59.681ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36492024-09-09T17:52:59.681ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36502024-09-09T17:52:59.683ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36512024-09-09T17:52:59.683ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36522024-09-09T17:52:59.684ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36532024-09-09T17:52:59.685ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36542024-09-09T17:52:59.687ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36552024-09-09T17:52:59.687ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36562024-09-09T17:52:59.689ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36572024-09-09T17:52:59.689ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36582024-09-09T17:52:59.691ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36592024-09-09T17:52:59.691ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36602024-09-09T17:52:59.693ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36612024-09-09T17:52:59.696ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ByName("proj-2453ac515eb") }, key: 5f83af01-72d6-4899-931a-3a1a6d862c47, lookup_type: ByName("default") }, key: 63b7b3bf-beb3-442f-8213-2b78d33de13e, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36622024-09-09T17:52:59.696ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36632024-09-09T17:52:59.696ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36642024-09-09T17:52:59.699ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36652024-09-09T17:52:59.699ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36662024-09-09T17:52:59.701ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36672024-09-09T17:52:59.701ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36682024-09-09T17:52:59.702ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36692024-09-09T17:52:59.703ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36702024-09-09T17:52:59.705ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36712024-09-09T17:52:59.707ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ByName("proj-2453ac515eb") }, key: 5f83af01-72d6-4899-931a-3a1a6d862c47, lookup_type: ByName("default") }, key: 63b7b3bf-beb3-442f-8213-2b78d33de13e, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36722024-09-09T17:52:59.707ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36732024-09-09T17:52:59.708ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36742024-09-09T17:52:59.710ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36752024-09-09T17:52:59.710ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36762024-09-09T17:52:59.715ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36772024-09-09T17:52:59.715ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36782024-09-09T17:52:59.726ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36792024-09-09T17:52:59.727ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36802024-09-09T17:52:59.736ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Signaled
36812024-09-09T17:52:59.736ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92721 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 8f2bab78-36b5-46a1-b391-1bf4a8af6619 response_code = 204 uri = /v1/vpc-subnets/default?project=proj-2453ac515eb&vpc=default
36822024-09-09T17:52:59.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36832024-09-09T17:52:59.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36842024-09-09T17:52:59.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36852024-09-09T17:52:59.738ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36862024-09-09T17:52:59.738ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36872024-09-09T17:52:59.740ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36882024-09-09T17:52:59.740ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36892024-09-09T17:52:59.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36902024-09-09T17:52:59.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36912024-09-09T17:52:59.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36922024-09-09T17:52:59.741ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
36932024-09-09T17:52:59.742ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36942024-09-09T17:52:59.743ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("token = \\"fa0231a0c9112e218dafc5bbb9e346846b4effe1\\"") } result = Ok(())
36952024-09-09T17:52:59.743ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36962024-09-09T17:52:59.743ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36972024-09-09T17:52:59.744ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36982024-09-09T17:52:59.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36992024-09-09T17:52:59.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37002024-09-09T17:52:59.745ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37012024-09-09T17:52:59.745ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37022024-09-09T17:52:59.746ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37032024-09-09T17:52:59.746ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37042024-09-09T17:52:59.747ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37052024-09-09T17:52:59.747ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37062024-09-09T17:52:59.749ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37072024-09-09T17:52:59.750ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
37082024-09-09T17:52:59.750ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37092024-09-09T17:52:59.750ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37102024-09-09T17:52:59.751ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37112024-09-09T17:52:59.752ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("fa0231a0c9112e218dafc5bbb9e346846b4effe1") } result = Ok(())
37122024-09-09T17:52:59.752ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37132024-09-09T17:52:59.752ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37142024-09-09T17:52:59.778ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37152024-09-09T17:52:59.778ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fa57e783-cd69-434a-993e-4ac66f7bcb56", "content-length": "372", "date": "Mon, 09 Sep 2024 17:52:59 GMT"} })
37162024-09-09T17:52:59.778ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37172024-09-09T17:52:59.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37182024-09-09T17:52:59.781ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37192024-09-09T17:52:59.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37202024-09-09T17:52:59.781ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37212024-09-09T17:52:59.782ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37222024-09-09T17:52:59.782ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37232024-09-09T17:52:59.783ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37242024-09-09T17:52:59.784ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37252024-09-09T17:52:59.784ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37262024-09-09T17:52:59.784ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37272024-09-09T17:52:59.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37282024-09-09T17:52:59.785ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37292024-09-09T17:52:59.786ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37302024-09-09T17:52:59.787ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37312024-09-09T17:52:59.787ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37322024-09-09T17:52:59.788ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f9ce0af2-8936-4e67-ad20-515332f841c6", "date": "Mon, 09 Sep 2024 17:52:59 GMT"} })
37332024-09-09T17:52:59.788ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
37342024-09-09T17:52:59.788ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37352024-09-09T17:52:59.788ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37362024-09-09T17:52:59.789ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 52.595698ms iteration = 3 status = {}
37372024-09-09T17:52:59.790ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37382024-09-09T17:52:59.790ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37392024-09-09T17:52:59.791ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37402024-09-09T17:52:59.791ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37412024-09-09T17:52:59.792ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37422024-09-09T17:52:59.793ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) } result = Ok(())
37432024-09-09T17:52:59.794ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37442024-09-09T17:52:59.794ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37452024-09-09T17:52:59.795ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37462024-09-09T17:52:59.795ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37472024-09-09T17:52:59.797ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37482024-09-09T17:52:59.797ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37492024-09-09T17:52:59.799ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37502024-09-09T17:52:59.799ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37512024-09-09T17:52:59.801ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37522024-09-09T17:52:59.801ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37532024-09-09T17:52:59.803ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37542024-09-09T17:52:59.803ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37552024-09-09T17:52:59.806ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37562024-09-09T17:52:59.806ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37572024-09-09T17:52:59.808ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37582024-09-09T17:52:59.810ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ByName("proj-2453ac515eb") }, key: 5f83af01-72d6-4899-931a-3a1a6d862c47, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37592024-09-09T17:52:59.810ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37602024-09-09T17:52:59.811ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37612024-09-09T17:52:59.813ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37622024-09-09T17:52:59.813ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37632024-09-09T17:52:59.815ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37642024-09-09T17:52:59.815ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37652024-09-09T17:52:59.817ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37662024-09-09T17:52:59.817ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37672024-09-09T17:52:59.819ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37682024-09-09T17:52:59.822ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ByName("proj-2453ac515eb") }, key: 5f83af01-72d6-4899-931a-3a1a6d862c47, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37692024-09-09T17:52:59.822ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37702024-09-09T17:52:59.822ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37712024-09-09T17:52:59.824ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37722024-09-09T17:52:59.824ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37732024-09-09T17:52:59.829ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37742024-09-09T17:52:59.829ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37752024-09-09T17:52:59.830ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37762024-09-09T17:52:59.831ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37772024-09-09T17:52:59.833ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37782024-09-09T17:52:59.833ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37792024-09-09T17:52:59.835ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37802024-09-09T17:52:59.835ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37812024-09-09T17:52:59.838ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37822024-09-09T17:52:59.840ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ByName("proj-2453ac515eb") }, key: 5f83af01-72d6-4899-931a-3a1a6d862c47, lookup_type: ByName("default") }, key: 15758aff-f88a-49fb-ae8e-b5a97ab40fbf, lookup_type: ById(15758aff-f88a-49fb-ae8e-b5a97ab40fbf) } result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37832024-09-09T17:52:59.840ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37842024-09-09T17:52:59.840ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37852024-09-09T17:52:59.846ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37862024-09-09T17:52:59.846ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37872024-09-09T17:52:59.850ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37882024-09-09T17:52:59.851ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37892024-09-09T17:52:59.853ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37902024-09-09T17:52:59.853ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37912024-09-09T17:52:59.855ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37922024-09-09T17:52:59.856ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37932024-09-09T17:52:59.858ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37942024-09-09T17:52:59.858ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37952024-09-09T17:52:59.860ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37962024-09-09T17:52:59.861ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37972024-09-09T17:52:59.862ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/vpcs/default?project=proj-2453ac515eb
37982024-09-09T17:52:59.865ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ByName("proj-2453ac515eb") }, key: 5f83af01-72d6-4899-931a-3a1a6d862c47, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
37992024-09-09T17:52:59.865ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-2453ac515eb
38002024-09-09T17:52:59.865ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-2453ac515eb
38012024-09-09T17:52:59.871ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 133666 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 5396d944-1595-49d1-8e53-291b88ec0316 response_code = 204 uri = /v1/vpcs/default?project=proj-2453ac515eb
38022024-09-09T17:52:59.872ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38032024-09-09T17:52:59.872ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38042024-09-09T17:52:59.874ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38052024-09-09T17:52:59.874ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38062024-09-09T17:52:59.876ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
38072024-09-09T17:52:59.877ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("token = \\"fa0231a0c9112e218dafc5bbb9e346846b4effe1\\"") } result = Ok(())
38082024-09-09T17:52:59.877ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38092024-09-09T17:52:59.877ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38102024-09-09T17:52:59.878ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38112024-09-09T17:52:59.879ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38122024-09-09T17:52:59.880ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38132024-09-09T17:52:59.880ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38142024-09-09T17:52:59.882ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38152024-09-09T17:52:59.882ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38162024-09-09T17:52:59.883ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
38172024-09-09T17:52:59.884ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
38182024-09-09T17:52:59.884ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38192024-09-09T17:52:59.885ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38202024-09-09T17:52:59.886ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
38212024-09-09T17:52:59.887ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "fa0231a0c9112e218dafc5bbb9e346846b4effe1", lookup_type: ByCompositeId("fa0231a0c9112e218dafc5bbb9e346846b4effe1") } result = Ok(())
38222024-09-09T17:52:59.887ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38232024-09-09T17:52:59.887ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38242024-09-09T17:52:59.898ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38252024-09-09T17:52:59.899ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38262024-09-09T17:52:59.900ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38272024-09-09T17:52:59.900ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38282024-09-09T17:52:59.902ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38292024-09-09T17:52:59.902ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38302024-09-09T17:52:59.903ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38312024-09-09T17:52:59.904ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38322024-09-09T17:52:59.905ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
38332024-09-09T17:52:59.906ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 0ee810e3-4a9a-4652-8bce-cc10884fa144, lookup_type: ById(0ee810e3-4a9a-4652-8bce-cc10884fa144) } result = Ok(())
38342024-09-09T17:52:59.906ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38352024-09-09T17:52:59.906ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38362024-09-09T17:52:59.908ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38372024-09-09T17:52:59.908ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38382024-09-09T17:52:59.909ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38392024-09-09T17:52:59.909ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38402024-09-09T17:52:59.910ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
38412024-09-09T17:52:59.912ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) } result = Ok(())
38422024-09-09T17:52:59.912ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38432024-09-09T17:52:59.912ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38442024-09-09T17:52:59.913ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38452024-09-09T17:52:59.913ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38462024-09-09T17:52:59.915ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38472024-09-09T17:52:59.915ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38482024-09-09T17:52:59.917ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38492024-09-09T17:52:59.918ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38502024-09-09T17:52:59.920ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38512024-09-09T17:52:59.920ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38522024-09-09T17:52:59.922ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38532024-09-09T17:52:59.922ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38542024-09-09T17:52:59.924ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/projects/proj-2453ac515eb
38552024-09-09T17:52:59.926ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ByName("proj-2453ac515eb") } result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38562024-09-09T17:52:59.926ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38572024-09-09T17:52:59.927ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38582024-09-09T17:52:59.929ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38592024-09-09T17:52:59.929ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38602024-09-09T17:52:59.931ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38612024-09-09T17:52:59.932ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38622024-09-09T17:52:59.933ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38632024-09-09T17:52:59.933ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38642024-09-09T17:52:59.936ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {(Silo, 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, "admin")} } uri = /v1/projects/proj-2453ac515eb
38652024-09-09T17:52:59.937ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: d34752cb-c5c0-447f-a1c6-cd1b028b290f, lookup_type: ByName("proj-2453ac515eb") } result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38662024-09-09T17:52:59.937ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38672024-09-09T17:52:59.938ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38682024-09-09T17:52:59.939ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38692024-09-09T17:52:59.940ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38702024-09-09T17:52:59.942ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38712024-09-09T17:52:59.942ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38722024-09-09T17:52:59.961ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38732024-09-09T17:52:59.961ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38742024-09-09T17:52:59.968ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38752024-09-09T17:52:59.968ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38762024-09-09T17:52:59.978ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38772024-09-09T17:52:59.978ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38782024-09-09T17:52:59.980ZDEBGnexus (dropshot_external): roles actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 roles = RoleSet { roles: {} } uri = /v1/projects/proj-2453ac515eb
38792024-09-09T17:52:59.980ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0ee810e3-4a9a-4652-8bce-cc10884fa144, silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, .. }) actor_id = 0ee810e3-4a9a-4652-8bce-cc10884fa144 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 resource = Database result = Ok(()) uri = /v1/projects/proj-2453ac515eb
38802024-09-09T17:52:59.988ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 116373 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:34074 req_id = 4d8e58d0-dcf4-41b8-a090-f79871421b52 response_code = 204 uri = /v1/projects/proj-2453ac515eb
38812024-09-09T17:53:03.426ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
38822024-09-09T17:53:03.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38832024-09-09T17:53:03.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38842024-09-09T17:53:03.427ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
38852024-09-09T17:53:03.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38862024-09-09T17:53:03.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38872024-09-09T17:53:03.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38882024-09-09T17:53:03.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38892024-09-09T17:53:03.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38902024-09-09T17:53:03.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38912024-09-09T17:53:03.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38922024-09-09T17:53:03.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38932024-09-09T17:53:03.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38942024-09-09T17:53:03.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
38952024-09-09T17:53:03.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38962024-09-09T17:53:03.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38972024-09-09T17:53:03.453ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38982024-09-09T17:53:03.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38992024-09-09T17:53:03.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.236095ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39002024-09-09T17:53:03.455ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
39012024-09-09T17:53:03.455ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.8841ms iteration = 5 status = {"enabled":false,"status":"first target blueprint","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z","time_found":"2024-09-09T17:53:03.455713138Z"}
39022024-09-09T17:53:03.455ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
39032024-09-09T17:53:03.455ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
39042024-09-09T17:53:03.455ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b
39052024-09-09T17:53:03.455ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.87\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b"}
39062024-09-09T17:53:03.455ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39072024-09-09T17:53:03.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39082024-09-09T17:53:03.455ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39092024-09-09T17:53:03.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39102024-09-09T17:53:03.456ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39112024-09-09T17:53:03.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39122024-09-09T17:53:03.456ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39132024-09-09T17:53:03.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39142024-09-09T17:53:03.456ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39152024-09-09T17:53:03.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39162024-09-09T17:53:03.457ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39172024-09-09T17:53:03.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39182024-09-09T17:53:03.459ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39192024-09-09T17:53:03.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39202024-09-09T17:53:03.459ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39212024-09-09T17:53:03.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39222024-09-09T17:53:03.461ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39232024-09-09T17:53:03.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39242024-09-09T17:53:03.461ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39252024-09-09T17:53:03.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39262024-09-09T17:53:03.463ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39272024-09-09T17:53:03.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39282024-09-09T17:53:03.463ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39292024-09-09T17:53:03.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39302024-09-09T17:53:03.464ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39312024-09-09T17:53:03.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39322024-09-09T17:53:03.464ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39332024-09-09T17:53:03.466ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39342024-09-09T17:53:03.466ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39352024-09-09T17:53:03.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39362024-09-09T17:53:03.499ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
39372024-09-09T17:53:03.531ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
39382024-09-09T17:53:03.562ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
39392024-09-09T17:53:03.594ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
39402024-09-09T17:53:03.624ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
39412024-09-09T17:53:04.611ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::6)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9f35a96a-723c-44b0-906b-76c0829fddc3", "content-length": "64", "date": "Mon, 09 Sep 2024 17:53:03 GMT"} })
39422024-09-09T17:53:04.611ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39432024-09-09T17:53:04.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39442024-09-09T17:53:04.613ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39452024-09-09T17:53:04.614ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39462024-09-09T17:53:04.614ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39472024-09-09T17:53:04.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39482024-09-09T17:53:04.634ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::4)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4bd04241-dd93-4ea8-ab01-5f9b7a01145b", "content-length": "64", "date": "Mon, 09 Sep 2024 17:53:04 GMT"} })
39492024-09-09T17:53:04.634ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39502024-09-09T17:53:04.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39512024-09-09T17:53:04.636ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39522024-09-09T17:53:04.637ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39532024-09-09T17:53:04.638ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39542024-09-09T17:53:04.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39552024-09-09T17:53:04.673ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::7)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8f8ec077-46c0-4153-bfcb-cf8c06384e30", "content-length": "64", "date": "Mon, 09 Sep 2024 17:53:03 GMT"} })
39562024-09-09T17:53:04.673ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39572024-09-09T17:53:04.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39582024-09-09T17:53:04.675ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39592024-09-09T17:53:04.677ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39602024-09-09T17:53:04.677ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39612024-09-09T17:53:04.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39622024-09-09T17:53:04.677ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::3)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e17a82c7-ee01-4850-8cf5-b12add88bfef", "content-length": "64", "date": "Mon, 09 Sep 2024 17:53:03 GMT"} })
39632024-09-09T17:53:04.677ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39642024-09-09T17:53:04.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39652024-09-09T17:53:04.679ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39662024-09-09T17:53:04.680ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39672024-09-09T17:53:04.680ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39682024-09-09T17:53:04.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39692024-09-09T17:53:04.683ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::5)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8b43e547-4038-45f6-8cb1-9dd45f1fabee", "content-length": "64", "date": "Mon, 09 Sep 2024 17:53:04 GMT"} })
39702024-09-09T17:53:04.683ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39712024-09-09T17:53:04.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39722024-09-09T17:53:04.685ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39732024-09-09T17:53:04.686ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39742024-09-09T17:53:04.686ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39752024-09-09T17:53:04.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39762024-09-09T17:53:04.692ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.236283293s iteration = 2 status = {"nsuccess":5}
39772024-09-09T17:53:05.533ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:48561 remote_addr = [fd00:1122:3344:101::d]:56239
39782024-09-09T17:53:05.539ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5291 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 0d59eff7-5213-461b-807d-3b5006318725 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
39792024-09-09T17:53:13.426ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
39802024-09-09T17:53:13.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39812024-09-09T17:53:13.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39822024-09-09T17:53:13.427ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
39832024-09-09T17:53:13.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39842024-09-09T17:53:13.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39852024-09-09T17:53:13.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39862024-09-09T17:53:13.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39872024-09-09T17:53:13.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39882024-09-09T17:53:13.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39892024-09-09T17:53:13.432ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39902024-09-09T17:53:13.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39912024-09-09T17:53:13.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39922024-09-09T17:53:13.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39932024-09-09T17:53:13.434ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.554279ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39942024-09-09T17:53:13.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39952024-09-09T17:53:13.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
39962024-09-09T17:53:13.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39972024-09-09T17:53:13.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39982024-09-09T17:53:13.447ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
39992024-09-09T17:53:13.447ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.569847ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
40002024-09-09T17:53:15.535ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1495 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 46cf0018-9be0-407b-8615-87ea81f6eb5f response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
40012024-09-09T17:53:21.900ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:52145
40022024-09-09T17:53:21.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52145 req_id = cac35306-ae36-4b34-a4a7-99f4bc4dd015 roles = RoleSet { roles: {} } uri = /metrics/producers
40032024-09-09T17:53:21.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52145 req_id = cac35306-ae36-4b34-a4a7-99f4bc4dd015 resource = Database result = Ok(()) uri = /metrics/producers
40042024-09-09T17:53:21.935ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
40052024-09-09T17:53:21.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52145 req_id = cac35306-ae36-4b34-a4a7-99f4bc4dd015 roles = RoleSet { roles: {} } uri = /metrics/producers
40062024-09-09T17:53:21.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52145 req_id = cac35306-ae36-4b34-a4a7-99f4bc4dd015 resource = Database result = Ok(()) uri = /metrics/producers
40072024-09-09T17:53:21.966ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
40082024-09-09T17:53:21.966ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "81776045-95cc-48ef-8109-b7defbb9821a", "date": "Mon, 09 Sep 2024 17:53:21 GMT"} })
40092024-09-09T17:53:21.966ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 1b80eb26-d978-4b89-a5d7-a50775a95a33
40102024-09-09T17:53:21.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 67608 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52145 req_id = cac35306-ae36-4b34-a4a7-99f4bc4dd015 response_code = 201 uri = /metrics/producers
40112024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
40122024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
40132024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
40142024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40152024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40162024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
40172024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
40182024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40192024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Timeout
40202024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
40212024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40222024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
40232024-09-09T17:53:23.426ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b
40242024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
40252024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.121\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b"}
40262024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
40272024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
40282024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Timeout
40292024-09-09T17:53:23.426ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-09 17:43:23.426608841 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
40302024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40312024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
40322024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
40332024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
40342024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40352024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
40362024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40372024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40382024-09-09T17:53:23.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40392024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40402024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40412024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
40422024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40432024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
40442024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
40452024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40462024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
40472024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
40482024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
40492024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
40502024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
40512024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40522024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
40532024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40542024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
40552024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40562024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
40572024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
40582024-09-09T17:53:23.427ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
40592024-09-09T17:53:23.427ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
40602024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
40612024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
40622024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40632024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40642024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
40652024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
40662024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
40672024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40682024-09-09T17:53:23.427ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("21f5073c-362d-497d-ae9e-f6ab85374703.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("42b0964a-b1a3-443e-b006-c18e1ad8d003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 33725, tv_nsec: 35348695 } })
40692024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
40702024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40712024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
40722024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40732024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
40742024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40752024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
40762024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40772024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
40782024-09-09T17:53:23.427ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("07c1bbdd-f080-4837-9528-41234be47bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 33725, tv_nsec: 35450276 } })
40792024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40802024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
40812024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40822024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
40832024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40842024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40852024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
40862024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
40872024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40882024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40892024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40902024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40912024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40922024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40932024-09-09T17:53:23.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40942024-09-09T17:53:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40952024-09-09T17:53:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40962024-09-09T17:53:23.429ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40972024-09-09T17:53:23.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40982024-09-09T17:53:23.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40992024-09-09T17:53:23.430ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.820812ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41002024-09-09T17:53:23.431ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41012024-09-09T17:53:23.432ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
41022024-09-09T17:53:23.432ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.462412ms iteration = 3 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
41032024-09-09T17:53:23.432ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-09 17:43:23.426608841 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
41042024-09-09T17:53:23.432ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.673473ms iteration = 2 status = {"expiration":"2024-09-09T17:43:23.426608841Z","pruned":[]}
41052024-09-09T17:53:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41062024-09-09T17:53:23.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41072024-09-09T17:53:23.432ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
41082024-09-09T17:53:23.432ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 6.345507ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
41092024-09-09T17:53:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41102024-09-09T17:53:23.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41112024-09-09T17:53:23.433ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41122024-09-09T17:53:23.433ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41132024-09-09T17:53:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41142024-09-09T17:53:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41152024-09-09T17:53:23.433ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33725, tv_nsec: 41939923 } })
41162024-09-09T17:53:23.434ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
41172024-09-09T17:53:23.435ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.621841ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
41182024-09-09T17:53:23.436ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33725, tv_nsec: 44032226 } })
41192024-09-09T17:53:23.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41202024-09-09T17:53:23.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41212024-09-09T17:53:23.437ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
41222024-09-09T17:53:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
41232024-09-09T17:53:23.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41242024-09-09T17:53:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41252024-09-09T17:53:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41262024-09-09T17:53:23.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41272024-09-09T17:53:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41282024-09-09T17:53:23.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41292024-09-09T17:53:23.442ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.924997ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
41302024-09-09T17:53:23.443ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41312024-09-09T17:53:23.444ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41322024-09-09T17:53:23.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41332024-09-09T17:53:23.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41342024-09-09T17:53:23.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41352024-09-09T17:53:23.445ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41362024-09-09T17:53:23.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41372024-09-09T17:53:23.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41382024-09-09T17:53:23.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41392024-09-09T17:53:23.463ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41402024-09-09T17:53:23.464ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41412024-09-09T17:53:23.464ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41422024-09-09T17:53:23.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41432024-09-09T17:53:23.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41442024-09-09T17:53:23.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41452024-09-09T17:53:23.469ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33725, tv_nsec: 77029809 } })
41462024-09-09T17:53:23.470ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
41472024-09-09T17:53:23.471ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41482024-09-09T17:53:23.471ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41492024-09-09T17:53:23.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41502024-09-09T17:53:23.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
41512024-09-09T17:53:23.474ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41522024-09-09T17:53:23.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41532024-09-09T17:53:23.491ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
41542024-09-09T17:53:23.491ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41552024-09-09T17:53:23.491ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41562024-09-09T17:53:23.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41572024-09-09T17:53:23.493ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41582024-09-09T17:53:23.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
41592024-09-09T17:53:23.496ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41602024-09-09T17:53:23.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41612024-09-09T17:53:23.497ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
41622024-09-09T17:53:23.497ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41632024-09-09T17:53:23.497ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 70.691924ms iteration = 3 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
41642024-09-09T17:53:23.504ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 77.189742ms iteration = 3 status = {"errors":[],"records_set_to_done":[]}
41652024-09-09T17:53:23.506ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41662024-09-09T17:53:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41672024-09-09T17:53:23.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41682024-09-09T17:53:23.510ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41692024-09-09T17:53:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41702024-09-09T17:53:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41712024-09-09T17:53:23.510ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41722024-09-09T17:53:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41732024-09-09T17:53:23.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41742024-09-09T17:53:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41752024-09-09T17:53:23.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 87.823675ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
41762024-09-09T17:53:23.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.868965ms iteration = 3 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
41772024-09-09T17:53:23.515ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41782024-09-09T17:53:23.516ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
41792024-09-09T17:53:23.517ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
41802024-09-09T17:53:23.517ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 89.702295ms iteration = 2 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
41812024-09-09T17:53:23.518ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41822024-09-09T17:53:23.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
41832024-09-09T17:53:23.518ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41842024-09-09T17:53:23.518ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41852024-09-09T17:53:23.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41862024-09-09T17:53:23.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
41872024-09-09T17:53:23.520ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41882024-09-09T17:53:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41892024-09-09T17:53:23.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41902024-09-09T17:53:23.521ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41912024-09-09T17:53:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41922024-09-09T17:53:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41932024-09-09T17:53:23.523ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
41942024-09-09T17:53:23.523ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
41952024-09-09T17:53:23.523ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
41962024-09-09T17:53:23.523ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41972024-09-09T17:53:23.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41982024-09-09T17:53:23.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
41992024-09-09T17:53:23.524ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42002024-09-09T17:53:23.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42012024-09-09T17:53:23.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42022024-09-09T17:53:23.525ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.206105ms iteration = 3 status = 0
42032024-09-09T17:53:23.525ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42042024-09-09T17:53:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42052024-09-09T17:53:23.527ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
42062024-09-09T17:53:23.527ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
42072024-09-09T17:53:23.527ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
42082024-09-09T17:53:23.527ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42092024-09-09T17:53:23.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42102024-09-09T17:53:23.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42112024-09-09T17:53:23.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42122024-09-09T17:53:23.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42132024-09-09T17:53:23.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42142024-09-09T17:53:23.529ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42152024-09-09T17:53:23.530ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42162024-09-09T17:53:23.532ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42172024-09-09T17:53:23.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42182024-09-09T17:53:23.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42192024-09-09T17:53:23.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42202024-09-09T17:53:23.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42212024-09-09T17:53:23.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42222024-09-09T17:53:23.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42232024-09-09T17:53:23.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42242024-09-09T17:53:23.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42252024-09-09T17:53:23.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42262024-09-09T17:53:23.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42272024-09-09T17:53:23.535ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
42282024-09-09T17:53:23.535ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 109.140169ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
42292024-09-09T17:53:23.536ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42302024-09-09T17:53:23.538ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
42312024-09-09T17:53:23.538ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 0 version = 2
42322024-09-09T17:53:23.538ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42332024-09-09T17:53:23.538ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
42342024-09-09T17:53:23.538ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42352024-09-09T17:53:23.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42362024-09-09T17:53:23.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42372024-09-09T17:53:23.539ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
42382024-09-09T17:53:23.539ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
42392024-09-09T17:53:23.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42402024-09-09T17:53:23.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42412024-09-09T17:53:23.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42422024-09-09T17:53:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42432024-09-09T17:53:23.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42442024-09-09T17:53:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42452024-09-09T17:53:23.549ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
42462024-09-09T17:53:23.549ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
42472024-09-09T17:53:23.549ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 122.538438ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
42482024-09-09T17:53:23.566ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 138.820713ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42492024-09-09T17:53:23.572ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
42502024-09-09T17:53:23.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42512024-09-09T17:53:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42522024-09-09T17:53:23.589ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 161.885248ms iteration = 5 status = {"physical_disks_added":0}
42532024-09-09T17:53:23.596ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-09T17:52:21.456201Z, time_modified: 2024-09-09T17:52:21.456201Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
42542024-09-09T17:53:23.596ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 169.502904ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]}},"default_endpoint":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
42552024-09-09T17:53:23.597ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42562024-09-09T17:53:23.597ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 170.013006ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42572024-09-09T17:53:23.617ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
42582024-09-09T17:53:23.617ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42592024-09-09T17:53:23.617ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3353ca96-a935-4506-b127-6f60645d37d4", "content-length": "26", "date": "Mon, 09 Sep 2024 17:53:23 GMT"} })
42602024-09-09T17:53:23.617ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42612024-09-09T17:53:23.619ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42622024-09-09T17:53:23.648ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42632024-09-09T17:53:23.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42642024-09-09T17:53:23.661ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f zone_address = fd00:1122:3344:101::2
42652024-09-09T17:53:23.661ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42662024-09-09T17:53:23.661ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "20ca66d9-4b04-4350-abfb-6ece94c4a5e2", "content-length": "26", "date": "Mon, 09 Sep 2024 17:53:23 GMT"} })
42672024-09-09T17:53:23.661ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42682024-09-09T17:53:23.663ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
42692024-09-09T17:53:23.698ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
42702024-09-09T17:53:23.698ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42712024-09-09T17:53:23.698ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f6c5782b-2872-473d-b6bf-86aff9259e84", "content-length": "26", "date": "Mon, 09 Sep 2024 17:53:23 GMT"} })
42722024-09-09T17:53:23.698ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42732024-09-09T17:53:23.700ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42742024-09-09T17:53:23.723ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
42752024-09-09T17:53:23.725ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
42762024-09-09T17:53:23.728ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42772024-09-09T17:53:23.729ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e4ff4ea1-25be-4916-8634-9521735d3984", "content-length": "372", "date": "Mon, 09 Sep 2024 17:53:23 GMT"} })
42782024-09-09T17:53:23.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42792024-09-09T17:53:23.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42802024-09-09T17:53:23.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42812024-09-09T17:53:23.731ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 1 version = 2
42822024-09-09T17:53:23.731ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
42832024-09-09T17:53:23.731ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-09 17:52:54.528560 UTC dns_group = external generation = 2
42842024-09-09T17:53:23.731ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 305.010227ms iteration = 3 status = {"generation":2}
42852024-09-09T17:53:23.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 304.128592ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
42862024-09-09T17:53:23.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42872024-09-09T17:53:23.732ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42882024-09-09T17:53:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42892024-09-09T17:53:23.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42902024-09-09T17:53:23.735ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42912024-09-09T17:53:23.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42922024-09-09T17:53:23.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42932024-09-09T17:53:23.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42942024-09-09T17:53:23.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42952024-09-09T17:53:23.736ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42962024-09-09T17:53:23.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42972024-09-09T17:53:23.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42982024-09-09T17:53:23.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42992024-09-09T17:53:23.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43002024-09-09T17:53:23.738ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
43012024-09-09T17:53:23.738ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
43022024-09-09T17:53:23.738ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-09 17:52:53.875764 UTC dns_group = internal generation = 1
43032024-09-09T17:53:23.738ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 312.3396ms iteration = 3 status = {"generation":1}
43042024-09-09T17:53:23.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43052024-09-09T17:53:23.741ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43062024-09-09T17:53:23.741ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1113c43d-a049-4b50-a6a7-2f6007fd6ec3", "date": "Mon, 09 Sep 2024 17:53:23 GMT"} })
43072024-09-09T17:53:23.743ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 315.961922ms iteration = 4 status = {}
43082024-09-09T17:53:23.890ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 464.21887ms iteration = 3 status = {}
43092024-09-09T17:53:23.895ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
43102024-09-09T17:53:23.897ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3aa7e6d6-18bd-47d9-a7ea-53038d88e9e1", "date": "Mon, 09 Sep 2024 17:53:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43112024-09-09T17:53:23.897ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43122024-09-09T17:53:23.898ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6fc0088f-b7fa-47c5-9948-f8ec2150ae2f", "date": "Mon, 09 Sep 2024 17:53:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43132024-09-09T17:53:23.898ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43142024-09-09T17:53:23.901ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5d92e2a0-7519-45c8-b40b-036b2685adb4", "date": "Mon, 09 Sep 2024 17:53:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43152024-09-09T17:53:23.901ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43162024-09-09T17:53:23.903ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43172024-09-09T17:53:23.903ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 476.662242ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
43182024-09-09T17:53:23.913ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
43192024-09-09T17:53:23.913ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "97334f60-3d90-4052-8611-639446fbfb19", "date": "Mon, 09 Sep 2024 17:53:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43202024-09-09T17:53:23.913ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43212024-09-09T17:53:23.917ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5926ce7e-539a-49d3-8301-c8b8b2719423", "date": "Mon, 09 Sep 2024 17:53:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43222024-09-09T17:53:23.917ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43232024-09-09T17:53:23.919ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43242024-09-09T17:53:23.919ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 492.570856ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
43252024-09-09T17:53:23.934ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43262024-09-09T17:53:23.935ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ea0beccc-2d09-49d3-9a01-6e5d1d1ee86c", "content-length": "1", "date": "Mon, 09 Sep 2024 17:53:23 GMT"} })
43272024-09-09T17:53:23.936ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43282024-09-09T17:53:23.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43292024-09-09T17:53:23.938ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 511.837809ms iteration = 3 status = null
43302024-09-09T17:53:23.955ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43312024-09-09T17:53:23.955ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5de360cf-9aba-4676-82e2-3669c49d4430", "content-length": "691", "date": "Mon, 09 Sep 2024 17:53:23 GMT"} })
43322024-09-09T17:53:23.955ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
43332024-09-09T17:53:23.955ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
43342024-09-09T17:53:23.955ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
43352024-09-09T17:53:23.957ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 529.920515ms iteration = 3 status = {}
43362024-09-09T17:53:23.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43372024-09-09T17:53:23.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43382024-09-09T17:53:23.985ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 8ddbbc53-8b49-46f3-8c46-10ed4300f6d2, rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e) } rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
43392024-09-09T17:53:23.985ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43402024-09-09T17:53:23.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43412024-09-09T17:53:24.052ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
43422024-09-09T17:53:24.053ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "361bbdab-c14f-49e0-bb51-5aa74d4d28c3", "content-length": "121", "date": "Mon, 09 Sep 2024 17:53:23 GMT"} })
43432024-09-09T17:53:24.053ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
43442024-09-09T17:53:24.053ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e
43452024-09-09T17:53:24.054ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43462024-09-09T17:53:24.054ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43472024-09-09T17:53:24.054ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
43482024-09-09T17:53:24.054ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
43492024-09-09T17:53:24.054ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
43502024-09-09T17:53:24.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43512024-09-09T17:53:24.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43522024-09-09T17:53:24.056ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
43532024-09-09T17:53:24.059ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c32d45c0-2cb1-41a9-a575-4ad318b4c9ad", "content-length": "2", "date": "Mon, 09 Sep 2024 17:53:23 GMT"} })
43542024-09-09T17:53:24.059ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
43552024-09-09T17:53:24.059ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "91a90860-6bb7-4314-9dd4-dd2d48b3bff5", "content-length": "51", "date": "Mon, 09 Sep 2024 17:53:23 GMT"} })
43562024-09-09T17:53:24.059ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
43572024-09-09T17:53:24.059ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
43582024-09-09T17:53:24.204ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5437fdfb-0755-41c9-a4b7-2d0055a31502", "date": "Mon, 09 Sep 2024 17:53:23 GMT"} })
43592024-09-09T17:53:24.204ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch = Switch0
43602024-09-09T17:53:24.204ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43612024-09-09T17:53:24.215ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "93ff8dc5-a216-4d9a-92af-9b8608be69ed", "content-length": "524", "date": "Mon, 09 Sep 2024 17:53:24 GMT"} })
43622024-09-09T17:53:24.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43632024-09-09T17:53:24.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43642024-09-09T17:53:24.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43652024-09-09T17:53:24.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43662024-09-09T17:53:24.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43672024-09-09T17:53:24.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43682024-09-09T17:53:24.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43692024-09-09T17:53:24.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43702024-09-09T17:53:24.248ZWARNnexus (BackgroundTasks): no bootstore config found in db background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1212 key = network_key rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
43712024-09-09T17:53:24.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43722024-09-09T17:53:24.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43732024-09-09T17:53:24.260ZINFOnexus (BackgroundTasks): updating bootstore config background_task = switch_port_config_manager config = EarlyNetworkConfig { body: EarlyNetworkConfigBody { ntp_servers: ["0.pool.ntp.org"], rack_network_config: Some(RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], autoneg: false, bgp_peers: [], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), local_pref: None, nexthop: 10.151.1.100, vlan_id: None }], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G }], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 } }) }, generation: 2, schema_version: 2 } file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1269 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
43742024-09-09T17:53:24.260ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = PUT rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43752024-09-09T17:53:24.272ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9efd80c9-b54b-41e5-bde7-ece5a525018a", "date": "Mon, 09 Sep 2024 17:53:24 GMT"} })
43762024-09-09T17:53:24.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43772024-09-09T17:53:24.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43782024-09-09T17:53:24.288ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 861.347526ms iteration = 3 status = {}
43792024-09-09T17:53:25.534ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1179 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 868443de-927b-4054-98a2-1452c5352198 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
43802024-09-09T17:53:33.426ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
43812024-09-09T17:53:33.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43822024-09-09T17:53:33.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43832024-09-09T17:53:33.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
43842024-09-09T17:53:33.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43852024-09-09T17:53:33.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43862024-09-09T17:53:33.456ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43872024-09-09T17:53:33.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43882024-09-09T17:53:33.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43892024-09-09T17:53:33.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43902024-09-09T17:53:33.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43912024-09-09T17:53:33.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43922024-09-09T17:53:33.467ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43932024-09-09T17:53:33.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43942024-09-09T17:53:33.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43952024-09-09T17:53:33.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
43962024-09-09T17:53:33.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43972024-09-09T17:53:33.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43982024-09-09T17:53:33.481ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
43992024-09-09T17:53:33.481ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.175773ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
44002024-09-09T17:53:33.481ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.736544ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44012024-09-09T17:53:35.535ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1788 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 2a5d3e32-b4b6-4dfb-b5b3-1476f5126b15 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
44022024-09-09T17:53:43.426ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
44032024-09-09T17:53:43.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44042024-09-09T17:53:43.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44052024-09-09T17:53:43.427ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
44062024-09-09T17:53:43.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44072024-09-09T17:53:43.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44082024-09-09T17:53:43.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44092024-09-09T17:53:43.430ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44102024-09-09T17:53:43.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44112024-09-09T17:53:43.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44122024-09-09T17:53:43.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44132024-09-09T17:53:43.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44142024-09-09T17:53:43.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44152024-09-09T17:53:43.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44162024-09-09T17:53:43.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44172024-09-09T17:53:43.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
44182024-09-09T17:53:43.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44192024-09-09T17:53:43.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44202024-09-09T17:53:43.446ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
44212024-09-09T17:53:43.446ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.388184ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
44222024-09-09T17:53:43.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.749234ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44232024-09-09T17:53:45.535ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1219 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = c2cea138-a28c-4fb6-b3a6-a2568f7e93f6 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
44242024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
44252024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
44262024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
44272024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44282024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
44292024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
44302024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
44312024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44322024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44332024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
44342024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
44352024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
44362024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44372024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
44382024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44392024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
44402024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
44412024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44422024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44432024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
44442024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
44452024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44462024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44472024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
44482024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44492024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44502024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
44512024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44522024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
44532024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44542024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
44552024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44562024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
44572024-09-09T17:53:53.427ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44582024-09-09T17:53:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44592024-09-09T17:53:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
44602024-09-09T17:53:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44612024-09-09T17:53:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44622024-09-09T17:53:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44632024-09-09T17:53:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44642024-09-09T17:53:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44652024-09-09T17:53:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44662024-09-09T17:53:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44672024-09-09T17:53:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44682024-09-09T17:53:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44692024-09-09T17:53:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
44702024-09-09T17:53:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44712024-09-09T17:53:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44722024-09-09T17:53:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44732024-09-09T17:53:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44742024-09-09T17:53:53.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44752024-09-09T17:53:53.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44762024-09-09T17:53:53.430ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33755, tv_nsec: 38444305 } })
44772024-09-09T17:53:53.431ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.573531ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44782024-09-09T17:53:53.431ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33755, tv_nsec: 39537392 } })
44792024-09-09T17:53:53.432ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
44802024-09-09T17:53:53.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44812024-09-09T17:53:53.432ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44822024-09-09T17:53:53.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44832024-09-09T17:53:53.432ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
44842024-09-09T17:53:53.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44852024-09-09T17:53:53.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44862024-09-09T17:53:53.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44872024-09-09T17:53:53.436ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44882024-09-09T17:53:53.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44892024-09-09T17:53:53.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44902024-09-09T17:53:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44912024-09-09T17:53:53.446ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33755, tv_nsec: 54228888 } })
44922024-09-09T17:53:53.448ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
44932024-09-09T17:53:53.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44942024-09-09T17:53:53.480ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44952024-09-09T17:53:53.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44962024-09-09T17:53:53.482ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44972024-09-09T17:53:53.482ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44982024-09-09T17:53:53.482ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44992024-09-09T17:53:53.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45002024-09-09T17:53:53.484ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45012024-09-09T17:53:53.484ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45022024-09-09T17:53:53.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45032024-09-09T17:53:53.485ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.917389ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
45042024-09-09T17:53:53.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45052024-09-09T17:53:53.489ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45062024-09-09T17:53:53.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45072024-09-09T17:53:53.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45082024-09-09T17:53:53.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45092024-09-09T17:53:53.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45102024-09-09T17:53:53.491ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45112024-09-09T17:53:53.491ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.227766ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45122024-09-09T17:53:53.492ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45132024-09-09T17:53:53.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45142024-09-09T17:53:53.492ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
45152024-09-09T17:53:53.492ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45162024-09-09T17:53:53.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45172024-09-09T17:53:53.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45182024-09-09T17:53:53.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45192024-09-09T17:53:53.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45202024-09-09T17:53:53.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45212024-09-09T17:53:53.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45222024-09-09T17:53:53.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45232024-09-09T17:53:53.495ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45242024-09-09T17:53:53.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45252024-09-09T17:53:53.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45262024-09-09T17:53:53.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45272024-09-09T17:53:53.498ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45282024-09-09T17:53:53.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45292024-09-09T17:53:53.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.206333ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
45302024-09-09T17:53:53.504ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45312024-09-09T17:53:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45322024-09-09T17:53:53.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45332024-09-09T17:53:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
45342024-09-09T17:53:53.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45352024-09-09T17:53:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45362024-09-09T17:53:53.513ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
45372024-09-09T17:53:53.513ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45382024-09-09T17:53:53.513ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9e171e2e-b446-4188-8993-86f796e46920", "content-length": "26", "date": "Mon, 09 Sep 2024 17:53:53 GMT"} })
45392024-09-09T17:53:53.514ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45402024-09-09T17:53:53.516ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45412024-09-09T17:53:53.517ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45422024-09-09T17:53:53.519ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45432024-09-09T17:53:53.519ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45442024-09-09T17:53:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45452024-09-09T17:53:53.523ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45462024-09-09T17:53:53.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45472024-09-09T17:53:53.524ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
45482024-09-09T17:53:53.524ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 97.075909ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
45492024-09-09T17:53:53.526ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 98.596828ms iteration = 4 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
45502024-09-09T17:53:53.526ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45512024-09-09T17:53:53.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45522024-09-09T17:53:53.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45532024-09-09T17:53:53.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
45542024-09-09T17:53:53.532ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45552024-09-09T17:53:53.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45562024-09-09T17:53:53.532ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 104.851885ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
45572024-09-09T17:53:53.534ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
45582024-09-09T17:53:53.534ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45592024-09-09T17:53:53.534ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 106.585084ms iteration = 4 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
45602024-09-09T17:53:53.534ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 107.081467ms iteration = 4 status = 0
45612024-09-09T17:53:53.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 108.133514ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
45622024-09-09T17:53:53.580ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45632024-09-09T17:53:53.580ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 152.502983ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45642024-09-09T17:53:53.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45652024-09-09T17:53:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45662024-09-09T17:53:53.607ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 180.064315ms iteration = 6 status = {"physical_disks_added":0}
45672024-09-09T17:53:53.618ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f zone_address = fd00:1122:3344:101::2
45682024-09-09T17:53:53.618ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45692024-09-09T17:53:53.618ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "acf6d18b-eb14-4d44-872b-2bd207662009", "content-length": "26", "date": "Mon, 09 Sep 2024 17:53:53 GMT"} })
45702024-09-09T17:53:53.618ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45712024-09-09T17:53:53.619ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
45722024-09-09T17:53:53.624ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
45732024-09-09T17:53:53.624ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45742024-09-09T17:53:53.625ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f7d7ddd5-42c9-4212-aa16-13b5c5d0f0aa", "content-length": "26", "date": "Mon, 09 Sep 2024 17:53:53 GMT"} })
45752024-09-09T17:53:53.625ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45762024-09-09T17:53:53.627ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45772024-09-09T17:53:53.629ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 201.794942ms iteration = 4 status = {}
45782024-09-09T17:53:53.675ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45792024-09-09T17:53:53.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45802024-09-09T17:53:53.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45812024-09-09T17:53:53.679ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45822024-09-09T17:53:53.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45832024-09-09T17:53:53.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45842024-09-09T17:53:53.680ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45852024-09-09T17:53:53.681ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45862024-09-09T17:53:53.681ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b4ff9b69-9c25-4264-bfdf-60c4fe86869d", "content-length": "372", "date": "Mon, 09 Sep 2024 17:53:53 GMT"} })
45872024-09-09T17:53:53.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45882024-09-09T17:53:53.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45892024-09-09T17:53:53.682ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45902024-09-09T17:53:53.682ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45912024-09-09T17:53:53.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45922024-09-09T17:53:53.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45932024-09-09T17:53:53.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45942024-09-09T17:53:53.688ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45952024-09-09T17:53:53.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45962024-09-09T17:53:53.691ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45972024-09-09T17:53:53.691ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7ce7c922-950f-4568-816e-09a73fba22f9", "date": "Mon, 09 Sep 2024 17:53:53 GMT"} })
45982024-09-09T17:53:53.693ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 265.357144ms iteration = 5 status = {}
45992024-09-09T17:53:53.720ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46002024-09-09T17:53:53.720ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "09746c7b-f977-4356-965c-6de85aa19e6d", "content-length": "1", "date": "Mon, 09 Sep 2024 17:53:53 GMT"} })
46012024-09-09T17:53:53.721ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46022024-09-09T17:53:53.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46032024-09-09T17:53:53.723ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 296.113015ms iteration = 4 status = null
46042024-09-09T17:53:53.756ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46052024-09-09T17:53:53.757ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dc16c25b-0978-41d2-95f5-2f0dddcb1abc", "content-length": "691", "date": "Mon, 09 Sep 2024 17:53:53 GMT"} })
46062024-09-09T17:53:53.757ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
46072024-09-09T17:53:53.757ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
46082024-09-09T17:53:53.757ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
46092024-09-09T17:53:53.758ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 331.16567ms iteration = 4 status = {}
46102024-09-09T17:53:53.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46112024-09-09T17:53:53.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46122024-09-09T17:53:53.807ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 8ddbbc53-8b49-46f3-8c46-10ed4300f6d2, rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e) } rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
46132024-09-09T17:53:53.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46142024-09-09T17:53:53.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46152024-09-09T17:53:53.818ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46162024-09-09T17:53:53.819ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f4662d1e-df34-4479-b728-77db51accf1a", "content-length": "121", "date": "Mon, 09 Sep 2024 17:53:53 GMT"} })
46172024-09-09T17:53:53.819ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
46182024-09-09T17:53:53.819ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e
46192024-09-09T17:53:53.819ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46202024-09-09T17:53:53.819ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46212024-09-09T17:53:53.819ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
46222024-09-09T17:53:53.819ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
46232024-09-09T17:53:53.819ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
46242024-09-09T17:53:53.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46252024-09-09T17:53:53.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46262024-09-09T17:53:53.834ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46272024-09-09T17:53:53.834ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ceb201ad-7792-4b8a-a402-28a44c6f2352", "content-length": "2", "date": "Mon, 09 Sep 2024 17:53:53 GMT"} })
46282024-09-09T17:53:53.834ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46292024-09-09T17:53:53.834ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "14b3bb50-7048-45f9-8cca-4397b5f381be", "content-length": "51", "date": "Mon, 09 Sep 2024 17:53:53 GMT"} })
46302024-09-09T17:53:53.834ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
46312024-09-09T17:53:53.834ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46322024-09-09T17:53:54.036ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8c216c13-8442-4562-9327-9a349f034d00", "date": "Mon, 09 Sep 2024 17:53:53 GMT"} })
46332024-09-09T17:53:54.036ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch = Switch0
46342024-09-09T17:53:54.036ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46352024-09-09T17:53:54.037ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a024a6a3-4b61-4f03-b954-cea9f15d3e28", "content-length": "667", "date": "Mon, 09 Sep 2024 17:53:54 GMT"} })
46362024-09-09T17:53:54.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46372024-09-09T17:53:54.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46382024-09-09T17:53:54.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46392024-09-09T17:53:54.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46402024-09-09T17:53:54.080ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46412024-09-09T17:53:54.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46422024-09-09T17:53:54.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46432024-09-09T17:53:54.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46442024-09-09T17:53:54.090ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 663.212666ms iteration = 4 status = {}
46452024-09-09T17:53:55.535ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1125 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = edc2007c-49a3-4b67-a888-525918cd6e86 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
46462024-09-09T17:54:03.427ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
46472024-09-09T17:54:03.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46482024-09-09T17:54:03.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46492024-09-09T17:54:03.427ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
46502024-09-09T17:54:03.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46512024-09-09T17:54:03.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46522024-09-09T17:54:03.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46532024-09-09T17:54:03.429ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46542024-09-09T17:54:03.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46552024-09-09T17:54:03.431ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.030253ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46562024-09-09T17:54:03.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46572024-09-09T17:54:03.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46582024-09-09T17:54:03.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46592024-09-09T17:54:03.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46602024-09-09T17:54:03.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46612024-09-09T17:54:03.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46622024-09-09T17:54:03.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
46632024-09-09T17:54:03.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46642024-09-09T17:54:03.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46652024-09-09T17:54:03.446ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
46662024-09-09T17:54:03.446ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.937211ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
46672024-09-09T17:54:05.535ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1113 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 652353ab-0287-468b-b170-f41e58cddbcf response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
46682024-09-09T17:54:13.427ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
46692024-09-09T17:54:13.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46702024-09-09T17:54:13.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46712024-09-09T17:54:13.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
46722024-09-09T17:54:13.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46732024-09-09T17:54:13.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46742024-09-09T17:54:13.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46752024-09-09T17:54:13.430ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46762024-09-09T17:54:13.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46772024-09-09T17:54:13.432ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.971873ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46782024-09-09T17:54:13.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46792024-09-09T17:54:13.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46802024-09-09T17:54:13.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46812024-09-09T17:54:13.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46822024-09-09T17:54:13.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46832024-09-09T17:54:13.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46842024-09-09T17:54:13.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
46852024-09-09T17:54:13.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46862024-09-09T17:54:13.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46872024-09-09T17:54:13.445ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
46882024-09-09T17:54:13.445ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.158991ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
46892024-09-09T17:54:15.534ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1104 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = d228d490-36f3-42f4-841c-466c06cb85ac response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
46902024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
46912024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
46922024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46932024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
46942024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
46952024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46962024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
46972024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
46982024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46992024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47002024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
47012024-09-09T17:54:23.427ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b
47022024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.24\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b"}
47032024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
47042024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
47052024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
47062024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
47072024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
47082024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
47092024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
47102024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47112024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
47122024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
47132024-09-09T17:54:23.427ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-09 17:44:23.427855616 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
47142024-09-09T17:54:23.427ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
47152024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47162024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47172024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
47182024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47192024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47202024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
47212024-09-09T17:54:23.428ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("07c1bbdd-f080-4837-9528-41234be47bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 33785, tv_nsec: 35167848 } })
47222024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
47232024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
47242024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47252024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
47262024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47272024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
47282024-09-09T17:54:23.428ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
47292024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
47302024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
47312024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
47322024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
47332024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47342024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
47352024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47362024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
47372024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47382024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
47392024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
47402024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
47412024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47422024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47432024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47442024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
47452024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47462024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
47472024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
47482024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
47492024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47502024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
47512024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47522024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
47532024-09-09T17:54:23.428ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
47542024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47552024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
47562024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
47572024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47582024-09-09T17:54:23.428ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("21f5073c-362d-497d-ae9e-f6ab85374703.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("42b0964a-b1a3-443e-b006-c18e1ad8d003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 33785, tv_nsec: 35396449 } })
47592024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
47602024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47612024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
47622024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47632024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
47642024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47652024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47662024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
47672024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47682024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47692024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47702024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47712024-09-09T17:54:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
47722024-09-09T17:54:23.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47732024-09-09T17:54:23.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47742024-09-09T17:54:23.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47752024-09-09T17:54:23.429ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47762024-09-09T17:54:23.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47772024-09-09T17:54:23.431ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47782024-09-09T17:54:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47792024-09-09T17:54:23.431ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
47802024-09-09T17:54:23.431ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.973633ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
47812024-09-09T17:54:23.431ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.964404ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
47822024-09-09T17:54:23.433ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-09 17:44:23.427855616 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
47832024-09-09T17:54:23.433ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.963995ms iteration = 3 status = {"expiration":"2024-09-09T17:44:23.427855616Z","pruned":[]}
47842024-09-09T17:54:23.433ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47852024-09-09T17:54:23.434ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
47862024-09-09T17:54:23.434ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.291497ms iteration = 4 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
47872024-09-09T17:54:23.434ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47882024-09-09T17:54:23.435ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33785, tv_nsec: 41975698 } })
47892024-09-09T17:54:23.436ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47902024-09-09T17:54:23.436ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47912024-09-09T17:54:23.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47922024-09-09T17:54:23.436ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33785, tv_nsec: 43663998 } })
47932024-09-09T17:54:23.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47942024-09-09T17:54:23.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47952024-09-09T17:54:23.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47962024-09-09T17:54:23.438ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
47972024-09-09T17:54:23.438ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
47982024-09-09T17:54:23.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47992024-09-09T17:54:23.438ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.446822ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
48002024-09-09T17:54:23.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48012024-09-09T17:54:23.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48022024-09-09T17:54:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48032024-09-09T17:54:23.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48042024-09-09T17:54:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48052024-09-09T17:54:23.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
48062024-09-09T17:54:23.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48072024-09-09T17:54:23.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48082024-09-09T17:54:23.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48092024-09-09T17:54:23.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48102024-09-09T17:54:23.443ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48112024-09-09T17:54:23.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48122024-09-09T17:54:23.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48132024-09-09T17:54:23.448ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48142024-09-09T17:54:23.449ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48152024-09-09T17:54:23.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48162024-09-09T17:54:23.451ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33785, tv_nsec: 57877551 } })
48172024-09-09T17:54:23.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48182024-09-09T17:54:23.452ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
48192024-09-09T17:54:23.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48202024-09-09T17:54:23.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48212024-09-09T17:54:23.455ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48222024-09-09T17:54:23.462ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48232024-09-09T17:54:23.462ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48242024-09-09T17:54:23.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48252024-09-09T17:54:23.480ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48262024-09-09T17:54:23.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
48272024-09-09T17:54:23.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48282024-09-09T17:54:23.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48292024-09-09T17:54:23.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48302024-09-09T17:54:23.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48312024-09-09T17:54:23.493ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
48322024-09-09T17:54:23.494ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
48332024-09-09T17:54:23.494ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 65.633985ms iteration = 3 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
48342024-09-09T17:54:23.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48352024-09-09T17:54:23.501ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48362024-09-09T17:54:23.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48372024-09-09T17:54:23.504ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.853735ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
48382024-09-09T17:54:23.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48392024-09-09T17:54:23.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48402024-09-09T17:54:23.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48412024-09-09T17:54:23.506ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48422024-09-09T17:54:23.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48432024-09-09T17:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48442024-09-09T17:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
48452024-09-09T17:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
48462024-09-09T17:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
48472024-09-09T17:54:23.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48482024-09-09T17:54:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48492024-09-09T17:54:23.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48502024-09-09T17:54:23.512ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 84.322354ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
48512024-09-09T17:54:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48522024-09-09T17:54:23.521ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48532024-09-09T17:54:23.522ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.304242ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48542024-09-09T17:54:23.522ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
48552024-09-09T17:54:23.522ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
48562024-09-09T17:54:23.522ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
48572024-09-09T17:54:23.522ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48582024-09-09T17:54:23.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48592024-09-09T17:54:23.523ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48602024-09-09T17:54:23.523ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
48612024-09-09T17:54:23.523ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
48622024-09-09T17:54:23.523ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48632024-09-09T17:54:23.524ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48642024-09-09T17:54:23.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48652024-09-09T17:54:23.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48662024-09-09T17:54:23.527ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48672024-09-09T17:54:23.527ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48682024-09-09T17:54:23.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48692024-09-09T17:54:23.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48702024-09-09T17:54:23.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
48712024-09-09T17:54:23.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48722024-09-09T17:54:23.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48732024-09-09T17:54:23.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
48742024-09-09T17:54:23.531ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48752024-09-09T17:54:23.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48762024-09-09T17:54:23.538ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48772024-09-09T17:54:23.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48782024-09-09T17:54:23.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48792024-09-09T17:54:23.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48802024-09-09T17:54:23.545ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
48812024-09-09T17:54:23.545ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 117.562599ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
48822024-09-09T17:54:23.545ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48832024-09-09T17:54:23.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
48842024-09-09T17:54:23.549ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48852024-09-09T17:54:23.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48862024-09-09T17:54:23.552ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 123.899355ms iteration = 5 status = 0
48872024-09-09T17:54:23.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48882024-09-09T17:54:23.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48892024-09-09T17:54:23.566ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 138.566681ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
48902024-09-09T17:54:23.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 141.802921ms iteration = 5 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
48912024-09-09T17:54:23.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48922024-09-09T17:54:23.577ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
48932024-09-09T17:54:23.577ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
48942024-09-09T17:54:23.577ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
48952024-09-09T17:54:23.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48962024-09-09T17:54:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48972024-09-09T17:54:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48982024-09-09T17:54:23.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48992024-09-09T17:54:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49002024-09-09T17:54:23.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49012024-09-09T17:54:23.580ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
49022024-09-09T17:54:23.580ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 0 version = 2
49032024-09-09T17:54:23.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49042024-09-09T17:54:23.580ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
49052024-09-09T17:54:23.580ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49062024-09-09T17:54:23.580ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 151.926991ms iteration = 5 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
49072024-09-09T17:54:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49082024-09-09T17:54:23.582ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
49092024-09-09T17:54:23.582ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
49102024-09-09T17:54:23.582ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 154.031883ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
49112024-09-09T17:54:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49122024-09-09T17:54:23.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49132024-09-09T17:54:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49142024-09-09T17:54:23.584ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49152024-09-09T17:54:23.585ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 156.566987ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49162024-09-09T17:54:23.586ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49172024-09-09T17:54:23.586ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
49182024-09-09T17:54:23.586ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
49192024-09-09T17:54:23.586ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49202024-09-09T17:54:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49212024-09-09T17:54:23.587ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
49222024-09-09T17:54:23.587ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
49232024-09-09T17:54:23.589ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49242024-09-09T17:54:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49252024-09-09T17:54:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49262024-09-09T17:54:23.590ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49272024-09-09T17:54:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49282024-09-09T17:54:23.590ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
49292024-09-09T17:54:23.590ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49302024-09-09T17:54:23.591ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "522bb7e2-b293-4fc4-b8ef-fd95da22d1d6", "content-length": "26", "date": "Mon, 09 Sep 2024 17:54:23 GMT"} })
49312024-09-09T17:54:23.591ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49322024-09-09T17:54:23.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49332024-09-09T17:54:23.593ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49342024-09-09T17:54:23.593ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49352024-09-09T17:54:23.594ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 1 version = 2
49362024-09-09T17:54:23.594ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
49372024-09-09T17:54:23.594ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-09 17:52:54.528560 UTC dns_group = external generation = 2
49382024-09-09T17:54:23.594ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 167.074599ms iteration = 4 status = {"generation":2}
49392024-09-09T17:54:23.595ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49402024-09-09T17:54:23.595ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49412024-09-09T17:54:23.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49422024-09-09T17:54:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49432024-09-09T17:54:23.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49442024-09-09T17:54:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49452024-09-09T17:54:23.599ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
49462024-09-09T17:54:23.599ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
49472024-09-09T17:54:23.599ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-09 17:52:53.875764 UTC dns_group = internal generation = 1
49482024-09-09T17:54:23.599ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 171.597316ms iteration = 4 status = {"generation":1}
49492024-09-09T17:54:23.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 174.985165ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
49502024-09-09T17:54:23.617ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49512024-09-09T17:54:23.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49522024-09-09T17:54:23.631ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
49532024-09-09T17:54:23.631ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49542024-09-09T17:54:23.632ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ae7f4968-27af-4d53-82c0-85967a315b8b", "content-length": "26", "date": "Mon, 09 Sep 2024 17:54:23 GMT"} })
49552024-09-09T17:54:23.632ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49562024-09-09T17:54:23.632ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-09T17:52:21.456201Z, time_modified: 2024-09-09T17:52:21.456201Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
49572024-09-09T17:54:23.632ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 205.118792ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]}},"default_endpoint":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
49582024-09-09T17:54:23.634ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49592024-09-09T17:54:23.641ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f zone_address = fd00:1122:3344:101::2
49602024-09-09T17:54:23.641ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49612024-09-09T17:54:23.641ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "22671f09-eed2-4be6-8e15-01047e67faf6", "content-length": "26", "date": "Mon, 09 Sep 2024 17:54:23 GMT"} })
49622024-09-09T17:54:23.641ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49632024-09-09T17:54:23.643ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
49642024-09-09T17:54:23.654ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 226.517108ms iteration = 7 status = {"physical_disks_added":0}
49652024-09-09T17:54:23.701ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49662024-09-09T17:54:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49672024-09-09T17:54:23.703ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49682024-09-09T17:54:23.705ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49692024-09-09T17:54:23.705ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49702024-09-09T17:54:23.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49712024-09-09T17:54:23.707ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49722024-09-09T17:54:23.709ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49732024-09-09T17:54:23.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49742024-09-09T17:54:23.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49752024-09-09T17:54:23.790ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
49762024-09-09T17:54:23.876ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49772024-09-09T17:54:23.876ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "da2f1713-cef7-495c-bf25-1ebed9da8b2d", "content-length": "372", "date": "Mon, 09 Sep 2024 17:54:23 GMT"} })
49782024-09-09T17:54:23.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49792024-09-09T17:54:23.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49802024-09-09T17:54:23.881ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49812024-09-09T17:54:23.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49822024-09-09T17:54:23.910ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 483.14612ms iteration = 5 status = {}
49832024-09-09T17:54:23.912ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
49842024-09-09T17:54:23.912ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5a550afb-65cf-40c4-93d3-9c2b3a63744f", "date": "Mon, 09 Sep 2024 17:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49852024-09-09T17:54:23.912ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49862024-09-09T17:54:23.915ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "81e9f180-4a64-45f3-ac73-b3cdda850feb", "date": "Mon, 09 Sep 2024 17:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49872024-09-09T17:54:23.915ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49882024-09-09T17:54:23.917ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49892024-09-09T17:54:23.917ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 489.94249ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
49902024-09-09T17:54:23.943ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
49912024-09-09T17:54:23.943ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6b577d6e-1a4a-43cc-879c-6e43e9ff7751", "content-length": "1", "date": "Mon, 09 Sep 2024 17:54:23 GMT"} })
49922024-09-09T17:54:23.945ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49932024-09-09T17:54:23.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49942024-09-09T17:54:23.954ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
49952024-09-09T17:54:23.955ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0b103171-9a6a-4b49-874c-7ccd7e10ab74", "date": "Mon, 09 Sep 2024 17:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
49962024-09-09T17:54:23.955ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
49972024-09-09T17:54:23.956ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49982024-09-09T17:54:23.956ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "87dd53cb-667b-4a10-b982-3ad37260196b", "content-length": "691", "date": "Mon, 09 Sep 2024 17:54:23 GMT"} })
49992024-09-09T17:54:23.956ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
50002024-09-09T17:54:23.956ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
50012024-09-09T17:54:23.956ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
50022024-09-09T17:54:23.957ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7449b75e-4930-4857-b0e1-10090d6cbda0", "date": "Mon, 09 Sep 2024 17:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
50032024-09-09T17:54:23.957ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
50042024-09-09T17:54:23.959ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 531.337144ms iteration = 5 status = null
50052024-09-09T17:54:23.959ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 530.8496ms iteration = 5 status = {}
50062024-09-09T17:54:23.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50072024-09-09T17:54:23.959ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "01ff1af1-b607-46c4-bce0-f8f45a9e35e0", "date": "Mon, 09 Sep 2024 17:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
50082024-09-09T17:54:23.959ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
50092024-09-09T17:54:23.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50102024-09-09T17:54:23.961ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
50112024-09-09T17:54:23.961ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 533.498806ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
50122024-09-09T17:54:23.963ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50132024-09-09T17:54:23.963ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "64471f78-d4cc-4010-84df-0853fc9b6d93", "date": "Mon, 09 Sep 2024 17:54:23 GMT"} })
50142024-09-09T17:54:23.964ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 536.241182ms iteration = 6 status = {}
50152024-09-09T17:54:23.995ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50162024-09-09T17:54:23.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50172024-09-09T17:54:23.997ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 8ddbbc53-8b49-46f3-8c46-10ed4300f6d2, rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e) } rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
50182024-09-09T17:54:23.997ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50192024-09-09T17:54:23.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50202024-09-09T17:54:24.004ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50212024-09-09T17:54:24.005ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4b2e1fdd-65e3-41f3-a549-eae03962090e", "content-length": "121", "date": "Mon, 09 Sep 2024 17:54:23 GMT"} })
50222024-09-09T17:54:24.005ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
50232024-09-09T17:54:24.005ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e
50242024-09-09T17:54:24.005ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50252024-09-09T17:54:24.005ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50262024-09-09T17:54:24.005ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
50272024-09-09T17:54:24.005ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
50282024-09-09T17:54:24.005ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
50292024-09-09T17:54:24.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50302024-09-09T17:54:24.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50312024-09-09T17:54:24.007ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
50322024-09-09T17:54:24.007ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e1fe9764-ad8a-4d76-a02b-e6a7bf9648b0", "content-length": "2", "date": "Mon, 09 Sep 2024 17:54:23 GMT"} })
50332024-09-09T17:54:24.007ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
50342024-09-09T17:54:24.007ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dbd746a8-dc07-450a-8419-d50b4201ce81", "content-length": "51", "date": "Mon, 09 Sep 2024 17:54:23 GMT"} })
50352024-09-09T17:54:24.007ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
50362024-09-09T17:54:24.007ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
50372024-09-09T17:54:24.206ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a6fc0a77-bc38-4a76-a85d-c5f4e1e95bde", "date": "Mon, 09 Sep 2024 17:54:24 GMT"} })
50382024-09-09T17:54:24.206ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch = Switch0
50392024-09-09T17:54:24.206ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
50402024-09-09T17:54:24.207ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5cf7fa60-fbde-4df6-b93f-cd8bc52c37d7", "content-length": "667", "date": "Mon, 09 Sep 2024 17:54:24 GMT"} })
50412024-09-09T17:54:24.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50422024-09-09T17:54:24.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50432024-09-09T17:54:24.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50442024-09-09T17:54:24.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50452024-09-09T17:54:24.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50462024-09-09T17:54:24.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50472024-09-09T17:54:24.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50482024-09-09T17:54:24.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50492024-09-09T17:54:24.225ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 797.343122ms iteration = 5 status = {}
50502024-09-09T17:54:25.536ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1737 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = a0e1b771-8114-4858-ac79-3cbd268b7094 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
50512024-09-09T17:54:33.427ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
50522024-09-09T17:54:33.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50532024-09-09T17:54:33.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50542024-09-09T17:54:33.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
50552024-09-09T17:54:33.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50562024-09-09T17:54:33.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50572024-09-09T17:54:33.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50582024-09-09T17:54:33.430ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50592024-09-09T17:54:33.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50602024-09-09T17:54:33.432ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.043034ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50612024-09-09T17:54:33.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50622024-09-09T17:54:33.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50632024-09-09T17:54:33.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50642024-09-09T17:54:33.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50652024-09-09T17:54:33.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50662024-09-09T17:54:33.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50672024-09-09T17:54:33.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
50682024-09-09T17:54:33.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50692024-09-09T17:54:33.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50702024-09-09T17:54:33.447ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
50712024-09-09T17:54:33.447ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.872346ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
50722024-09-09T17:54:35.536ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1141 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = cb82d026-fd19-4716-b6b1-8974a18a5030 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
50732024-09-09T17:54:43.428ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
50742024-09-09T17:54:43.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50752024-09-09T17:54:43.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50762024-09-09T17:54:43.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
50772024-09-09T17:54:43.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50782024-09-09T17:54:43.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50792024-09-09T17:54:43.430ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50802024-09-09T17:54:43.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50812024-09-09T17:54:43.432ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.304369ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50822024-09-09T17:54:43.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50832024-09-09T17:54:43.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50842024-09-09T17:54:43.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50852024-09-09T17:54:43.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50862024-09-09T17:54:43.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50872024-09-09T17:54:43.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50882024-09-09T17:54:43.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50892024-09-09T17:54:43.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
50902024-09-09T17:54:43.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50912024-09-09T17:54:43.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50922024-09-09T17:54:43.473ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
50932024-09-09T17:54:43.473ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.616172ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
50942024-09-09T17:54:45.536ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1467 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 4c87c918-b97c-4a83-ac5f-f700e3214da0 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
50952024-09-09T17:54:53.429ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
50962024-09-09T17:54:53.429ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
50972024-09-09T17:54:53.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50982024-09-09T17:54:53.429ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
50992024-09-09T17:54:53.429ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
51002024-09-09T17:54:53.429ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51012024-09-09T17:54:53.429ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
51022024-09-09T17:54:53.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51032024-09-09T17:54:53.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
51042024-09-09T17:54:53.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51052024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
51062024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
51072024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
51082024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
51092024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51102024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
51112024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51122024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
51132024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51142024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51152024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
51162024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
51172024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
51182024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51192024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
51202024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
51212024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51222024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
51232024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51242024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
51252024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51262024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
51272024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51282024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
51292024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51302024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
51312024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51322024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51332024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
51342024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51352024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51362024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51372024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51382024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51392024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
51402024-09-09T17:54:53.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51412024-09-09T17:54:53.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51422024-09-09T17:54:53.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51432024-09-09T17:54:53.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51442024-09-09T17:54:53.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51452024-09-09T17:54:53.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51462024-09-09T17:54:53.433ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.336366ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
51472024-09-09T17:54:53.433ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33815, tv_nsec: 39664637 } })
51482024-09-09T17:54:53.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51492024-09-09T17:54:53.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51502024-09-09T17:54:53.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51512024-09-09T17:54:53.435ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33815, tv_nsec: 40718453 } })
51522024-09-09T17:54:53.435ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
51532024-09-09T17:54:53.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51542024-09-09T17:54:53.436ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
51552024-09-09T17:54:53.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51562024-09-09T17:54:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
51572024-09-09T17:54:53.439ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51582024-09-09T17:54:53.439ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51592024-09-09T17:54:53.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51602024-09-09T17:54:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51612024-09-09T17:54:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51622024-09-09T17:54:53.440ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51632024-09-09T17:54:53.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51642024-09-09T17:54:53.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51652024-09-09T17:54:53.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51662024-09-09T17:54:53.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51672024-09-09T17:54:53.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51682024-09-09T17:54:53.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51692024-09-09T17:54:53.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51702024-09-09T17:54:53.448ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51712024-09-09T17:54:53.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51722024-09-09T17:54:53.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51732024-09-09T17:54:53.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51742024-09-09T17:54:53.452ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51752024-09-09T17:54:53.452ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51762024-09-09T17:54:53.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51772024-09-09T17:54:53.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51782024-09-09T17:54:53.453ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51792024-09-09T17:54:53.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51802024-09-09T17:54:53.454ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 24.023251ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
51812024-09-09T17:54:53.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51822024-09-09T17:54:53.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51832024-09-09T17:54:53.455ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33815, tv_nsec: 61353064 } })
51842024-09-09T17:54:53.456ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
51852024-09-09T17:54:53.459ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51862024-09-09T17:54:53.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51872024-09-09T17:54:53.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51882024-09-09T17:54:53.463ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51892024-09-09T17:54:53.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51902024-09-09T17:54:53.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
51912024-09-09T17:54:53.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51922024-09-09T17:54:53.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51932024-09-09T17:54:53.469ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51942024-09-09T17:54:53.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51952024-09-09T17:54:53.472ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51962024-09-09T17:54:53.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51972024-09-09T17:54:53.478ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
51982024-09-09T17:54:53.478ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.307139ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
51992024-09-09T17:54:53.479ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.724456ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
52002024-09-09T17:54:53.483ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52012024-09-09T17:54:53.483ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52022024-09-09T17:54:53.483ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.830569ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
52032024-09-09T17:54:53.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52042024-09-09T17:54:53.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52052024-09-09T17:54:53.484ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52062024-09-09T17:54:53.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52072024-09-09T17:54:53.485ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52082024-09-09T17:54:53.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52092024-09-09T17:54:53.487ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
52102024-09-09T17:54:53.487ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52112024-09-09T17:54:53.487ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52122024-09-09T17:54:53.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52132024-09-09T17:54:53.489ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.139306ms iteration = 6 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
52142024-09-09T17:54:53.491ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52152024-09-09T17:54:53.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52162024-09-09T17:54:53.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52172024-09-09T17:54:53.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
52182024-09-09T17:54:53.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52192024-09-09T17:54:53.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52202024-09-09T17:54:53.498ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 68.25849ms iteration = 6 status = 0
52212024-09-09T17:54:53.520ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52222024-09-09T17:54:53.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52232024-09-09T17:54:53.529ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 99.547954ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52242024-09-09T17:54:53.531ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
52252024-09-09T17:54:53.531ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52262024-09-09T17:54:53.531ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 101.442534ms iteration = 6 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
52272024-09-09T17:54:53.536ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
52282024-09-09T17:54:53.536ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52292024-09-09T17:54:53.536ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ac9cfba5-6593-4d26-89e7-4008712193d5", "content-length": "26", "date": "Mon, 09 Sep 2024 17:54:53 GMT"} })
52302024-09-09T17:54:53.536ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52312024-09-09T17:54:53.538ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
52322024-09-09T17:54:53.538ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 107.740431ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
52332024-09-09T17:54:53.538ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52342024-09-09T17:54:53.552ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 122.352346ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
52352024-09-09T17:54:53.583ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 153.150877ms iteration = 8 status = {"physical_disks_added":0}
52362024-09-09T17:54:53.586ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52372024-09-09T17:54:53.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52382024-09-09T17:54:53.612ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
52392024-09-09T17:54:53.612ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52402024-09-09T17:54:53.612ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ffe5d402-ba1b-482a-861f-183a48b0b5c5", "content-length": "26", "date": "Mon, 09 Sep 2024 17:54:53 GMT"} })
52412024-09-09T17:54:53.612ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52422024-09-09T17:54:53.614ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52432024-09-09T17:54:53.645ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f zone_address = fd00:1122:3344:101::2
52442024-09-09T17:54:53.645ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52452024-09-09T17:54:53.645ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "26fe0ad5-2edf-4dc4-99ee-ded6eb8959b3", "content-length": "26", "date": "Mon, 09 Sep 2024 17:54:53 GMT"} })
52462024-09-09T17:54:53.645ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52472024-09-09T17:54:53.646ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52482024-09-09T17:54:53.646ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5c08ccfd-8a69-47ab-84e1-9f9f45ef9efb", "content-length": "372", "date": "Mon, 09 Sep 2024 17:54:53 GMT"} })
52492024-09-09T17:54:53.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52502024-09-09T17:54:53.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52512024-09-09T17:54:53.647ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
52522024-09-09T17:54:53.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52532024-09-09T17:54:53.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52542024-09-09T17:54:53.650ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
52552024-09-09T17:54:53.650ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "02aac133-ecc1-4f9f-b3b0-4437530fdbab", "content-length": "1", "date": "Mon, 09 Sep 2024 17:54:53 GMT"} })
52562024-09-09T17:54:53.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52572024-09-09T17:54:53.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52582024-09-09T17:54:53.652ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52592024-09-09T17:54:53.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52602024-09-09T17:54:53.654ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 224.783537ms iteration = 6 status = null
52612024-09-09T17:54:53.655ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52622024-09-09T17:54:53.655ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "adb6fea2-764c-4adb-abf9-82ecd1c369c4", "date": "Mon, 09 Sep 2024 17:54:53 GMT"} })
52632024-09-09T17:54:53.656ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 226.183845ms iteration = 7 status = {}
52642024-09-09T17:54:53.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52652024-09-09T17:54:53.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52662024-09-09T17:54:53.681ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52672024-09-09T17:54:53.683ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52682024-09-09T17:54:53.683ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52692024-09-09T17:54:53.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52702024-09-09T17:54:53.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52712024-09-09T17:54:53.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52722024-09-09T17:54:53.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52732024-09-09T17:54:53.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52742024-09-09T17:54:53.741ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 312.185049ms iteration = 6 status = {}
52752024-09-09T17:54:53.900ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
52762024-09-09T17:54:53.901ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4e53ec1b-16dc-4c5d-be24-bd76fa2fc975", "content-length": "691", "date": "Mon, 09 Sep 2024 17:54:53 GMT"} })
52772024-09-09T17:54:53.901ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
52782024-09-09T17:54:53.901ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
52792024-09-09T17:54:53.901ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
52802024-09-09T17:54:53.902ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 471.955805ms iteration = 6 status = {}
52812024-09-09T17:54:53.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52822024-09-09T17:54:53.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52832024-09-09T17:54:53.918ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 8ddbbc53-8b49-46f3-8c46-10ed4300f6d2, rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e) } rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
52842024-09-09T17:54:53.918ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52852024-09-09T17:54:53.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52862024-09-09T17:54:53.927ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
52872024-09-09T17:54:53.927ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a6c000a7-df95-4df8-864f-2da9d812e784", "content-length": "121", "date": "Mon, 09 Sep 2024 17:54:53 GMT"} })
52882024-09-09T17:54:53.927ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
52892024-09-09T17:54:53.927ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e
52902024-09-09T17:54:53.927ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52912024-09-09T17:54:53.927ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52922024-09-09T17:54:53.927ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
52932024-09-09T17:54:53.927ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
52942024-09-09T17:54:53.927ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
52952024-09-09T17:54:53.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52962024-09-09T17:54:53.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52972024-09-09T17:54:53.930ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
52982024-09-09T17:54:53.930ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b5998045-49df-47eb-9a20-27f5ecf73309", "content-length": "2", "date": "Mon, 09 Sep 2024 17:54:53 GMT"} })
52992024-09-09T17:54:53.930ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
53002024-09-09T17:54:53.931ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "98c3f4c8-ba51-4045-aab1-871893ddd203", "content-length": "51", "date": "Mon, 09 Sep 2024 17:54:53 GMT"} })
53012024-09-09T17:54:53.931ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
53022024-09-09T17:54:53.931ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
53032024-09-09T17:54:54.027ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "35a91d40-00da-4603-82f1-c9f136e3d767", "date": "Mon, 09 Sep 2024 17:54:53 GMT"} })
53042024-09-09T17:54:54.027ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch = Switch0
53052024-09-09T17:54:54.027ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
53062024-09-09T17:54:54.028ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9cf5ed0e-f9e3-4cc7-ac95-a79be3bb1b3b", "content-length": "667", "date": "Mon, 09 Sep 2024 17:54:54 GMT"} })
53072024-09-09T17:54:54.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53082024-09-09T17:54:54.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53092024-09-09T17:54:54.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53102024-09-09T17:54:54.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53112024-09-09T17:54:54.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53122024-09-09T17:54:54.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53132024-09-09T17:54:54.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53142024-09-09T17:54:54.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53152024-09-09T17:54:54.050ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 620.284605ms iteration = 6 status = {}
53162024-09-09T17:54:55.537ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1809 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = f27a5f55-dae2-4e94-bc5d-123aa12cf576 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
53172024-09-09T17:54:57.030ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:52267
53182024-09-09T17:54:57.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52267 req_id = ea3b2a98-ebbb-4024-b81a-29bb3179f6bf roles = RoleSet { roles: {} } uri = /metrics/producers
53192024-09-09T17:54:57.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52267 req_id = ea3b2a98-ebbb-4024-b81a-29bb3179f6bf resource = Database result = Ok(()) uri = /metrics/producers
53202024-09-09T17:54:57.063ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
53212024-09-09T17:54:57.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52267 req_id = ea3b2a98-ebbb-4024-b81a-29bb3179f6bf roles = RoleSet { roles: {} } uri = /metrics/producers
53222024-09-09T17:54:57.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52267 req_id = ea3b2a98-ebbb-4024-b81a-29bb3179f6bf resource = Database result = Ok(()) uri = /metrics/producers
53232024-09-09T17:54:57.124ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
53242024-09-09T17:54:57.125ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "127bf63a-5a81-4c10-90ee-09da9db83a5c", "date": "Mon, 09 Sep 2024 17:54:57 GMT"} })
53252024-09-09T17:54:57.125ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 11e4ca7f-2a45-4733-9ef1-4614c608a84b
53262024-09-09T17:54:57.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96768 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52267 req_id = ea3b2a98-ebbb-4024-b81a-29bb3179f6bf response_code = 201 uri = /metrics/producers
53272024-09-09T17:55:00.213ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:53326
53282024-09-09T17:55:00.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53326 req_id = 89184d6a-d048-4690-9dfb-c0dd3372517a roles = RoleSet { roles: {} } uri = /metrics/producers
53292024-09-09T17:55:00.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53326 req_id = 89184d6a-d048-4690-9dfb-c0dd3372517a resource = Database result = Ok(()) uri = /metrics/producers
53302024-09-09T17:55:00.247ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
53312024-09-09T17:55:00.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53326 req_id = 89184d6a-d048-4690-9dfb-c0dd3372517a roles = RoleSet { roles: {} } uri = /metrics/producers
53322024-09-09T17:55:00.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53326 req_id = 89184d6a-d048-4690-9dfb-c0dd3372517a resource = Database result = Ok(()) uri = /metrics/producers
53332024-09-09T17:55:00.287ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
53342024-09-09T17:55:00.287ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b59837ff-1825-4e0a-8bdb-3cbcb0e0e32d", "date": "Mon, 09 Sep 2024 17:55:00 GMT"} })
53352024-09-09T17:55:00.287ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = fdca555f-3b9a-4118-ba07-7428edbb0dfc
53362024-09-09T17:55:00.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 76148 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53326 req_id = 89184d6a-d048-4690-9dfb-c0dd3372517a response_code = 201 uri = /metrics/producers
53372024-09-09T17:55:01.809ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:60318
53382024-09-09T17:55:01.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60318 req_id = 2c838646-0031-4e05-831f-e2b032710e42 roles = RoleSet { roles: {} } uri = /metrics/producers
53392024-09-09T17:55:01.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60318 req_id = 2c838646-0031-4e05-831f-e2b032710e42 resource = Database result = Ok(()) uri = /metrics/producers
53402024-09-09T17:55:01.842ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
53412024-09-09T17:55:01.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60318 req_id = 2c838646-0031-4e05-831f-e2b032710e42 roles = RoleSet { roles: {} } uri = /metrics/producers
53422024-09-09T17:55:01.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60318 req_id = 2c838646-0031-4e05-831f-e2b032710e42 resource = Database result = Ok(()) uri = /metrics/producers
53432024-09-09T17:55:01.874ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
53442024-09-09T17:55:01.875ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3546e29b-7543-4aaa-80ba-05641dc83ba5", "date": "Mon, 09 Sep 2024 17:55:01 GMT"} })
53452024-09-09T17:55:01.875ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60
53462024-09-09T17:55:01.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 68105 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60318 req_id = 2c838646-0031-4e05-831f-e2b032710e42 response_code = 201 uri = /metrics/producers
53472024-09-09T17:55:03.429ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
53482024-09-09T17:55:03.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53492024-09-09T17:55:03.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53502024-09-09T17:55:03.430ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
53512024-09-09T17:55:03.430ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53522024-09-09T17:55:03.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53532024-09-09T17:55:03.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53542024-09-09T17:55:03.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53552024-09-09T17:55:03.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53562024-09-09T17:55:03.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53572024-09-09T17:55:03.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53582024-09-09T17:55:03.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53592024-09-09T17:55:03.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53602024-09-09T17:55:03.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
53612024-09-09T17:55:03.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53622024-09-09T17:55:03.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53632024-09-09T17:55:03.448ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
53642024-09-09T17:55:03.448ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.78833ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
53652024-09-09T17:55:03.457ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53662024-09-09T17:55:03.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53672024-09-09T17:55:03.483ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.416104ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53682024-09-09T17:55:05.537ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1274 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 5f4e4ffc-68fe-497e-9362-a84bded2bc10 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
53692024-09-09T17:55:07.901ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:63060
53702024-09-09T17:55:07.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63060 req_id = 550260aa-655d-49db-9f6f-331e300f3602 roles = RoleSet { roles: {} } uri = /metrics/producers
53712024-09-09T17:55:07.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63060 req_id = 550260aa-655d-49db-9f6f-331e300f3602 resource = Database result = Ok(()) uri = /metrics/producers
53722024-09-09T17:55:07.934ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
53732024-09-09T17:55:07.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63060 req_id = 550260aa-655d-49db-9f6f-331e300f3602 roles = RoleSet { roles: {} } uri = /metrics/producers
53742024-09-09T17:55:07.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63060 req_id = 550260aa-655d-49db-9f6f-331e300f3602 resource = Database result = Ok(()) uri = /metrics/producers
53752024-09-09T17:55:07.945ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
53762024-09-09T17:55:07.946ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0e2056a8-db5e-41bb-8771-a625f41b65a7", "date": "Mon, 09 Sep 2024 17:55:07 GMT"} })
53772024-09-09T17:55:07.946ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = fd6a3800-ebfc-41fd-a922-894d8d51ff21
53782024-09-09T17:55:07.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 45984 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63060 req_id = 550260aa-655d-49db-9f6f-331e300f3602 response_code = 201 uri = /metrics/producers
53792024-09-09T17:55:13.430ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
53802024-09-09T17:55:13.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53812024-09-09T17:55:13.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53822024-09-09T17:55:13.430ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
53832024-09-09T17:55:13.430ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53842024-09-09T17:55:13.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53852024-09-09T17:55:13.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53862024-09-09T17:55:13.433ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53872024-09-09T17:55:13.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53882024-09-09T17:55:13.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53892024-09-09T17:55:13.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53902024-09-09T17:55:13.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53912024-09-09T17:55:13.435ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.546466ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53922024-09-09T17:55:13.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53932024-09-09T17:55:13.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53942024-09-09T17:55:13.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53952024-09-09T17:55:13.466ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
53962024-09-09T17:55:13.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53972024-09-09T17:55:13.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53982024-09-09T17:55:13.474ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
53992024-09-09T17:55:13.474ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.599661ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
54002024-09-09T17:55:15.537ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1128 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 91f92a93-6604-4378-8466-fafe1ab5d8d3 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
54012024-09-09T17:55:23.430ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
54022024-09-09T17:55:23.430ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
54032024-09-09T17:55:23.430ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
54042024-09-09T17:55:23.430ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54052024-09-09T17:55:23.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54062024-09-09T17:55:23.430ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
54072024-09-09T17:55:23.430ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
54082024-09-09T17:55:23.430ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
54092024-09-09T17:55:23.430ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54102024-09-09T17:55:23.430ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
54112024-09-09T17:55:23.430ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
54122024-09-09T17:55:23.430ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
54132024-09-09T17:55:23.430ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-09 17:45:23.430901575 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
54142024-09-09T17:55:23.430ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
54152024-09-09T17:55:23.430ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54162024-09-09T17:55:23.430ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
54172024-09-09T17:55:23.430ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
54182024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
54192024-09-09T17:55:23.431ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b
54202024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.96\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b"}
54212024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
54222024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
54232024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54242024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
54252024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
54262024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
54272024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54282024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
54292024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
54302024-09-09T17:55:23.431ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
54312024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
54322024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
54332024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
54342024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
54352024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
54362024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54372024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
54382024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54392024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
54402024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54412024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
54422024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
54432024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54442024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54452024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
54462024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
54472024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54482024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
54492024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
54502024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54512024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54522024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
54532024-09-09T17:55:23.431ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
54542024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54552024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
54562024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
54572024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54582024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
54592024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54602024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54612024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54622024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54632024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
54642024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54652024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54662024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54672024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54682024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54692024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
54702024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54712024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54722024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
54732024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
54742024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54752024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54762024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54772024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54782024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54792024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54802024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54812024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54822024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54832024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54842024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54852024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54862024-09-09T17:55:23.431ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54872024-09-09T17:55:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54882024-09-09T17:55:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54892024-09-09T17:55:23.432ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54902024-09-09T17:55:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54912024-09-09T17:55:23.432ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54922024-09-09T17:55:23.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54932024-09-09T17:55:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54942024-09-09T17:55:23.432ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54952024-09-09T17:55:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54962024-09-09T17:55:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54972024-09-09T17:55:23.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54982024-09-09T17:55:23.433ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("07c1bbdd-f080-4837-9528-41234be47bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 33845, tv_nsec: 37172387 } })
54992024-09-09T17:55:23.433ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("21f5073c-362d-497d-ae9e-f6ab85374703.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("42b0964a-b1a3-443e-b006-c18e1ad8d003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 33845, tv_nsec: 37265078 } })
55002024-09-09T17:55:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55012024-09-09T17:55:23.434ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.067654ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
55022024-09-09T17:55:23.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55032024-09-09T17:55:23.435ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55042024-09-09T17:55:23.437ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
55052024-09-09T17:55:23.437ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 6.101455ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
55062024-09-09T17:55:23.437ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.672089ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
55072024-09-09T17:55:23.437ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55082024-09-09T17:55:23.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55092024-09-09T17:55:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55102024-09-09T17:55:23.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
55112024-09-09T17:55:23.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 7.190152ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
55122024-09-09T17:55:23.438ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33845, tv_nsec: 42468339 } })
55132024-09-09T17:55:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55142024-09-09T17:55:23.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55152024-09-09T17:55:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55162024-09-09T17:55:23.440ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
55172024-09-09T17:55:23.442ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
55182024-09-09T17:55:23.442ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
55192024-09-09T17:55:23.442ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.308787ms iteration = 4 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
55202024-09-09T17:55:23.442ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-09 17:45:23.430901575 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
55212024-09-09T17:55:23.442ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.81845ms iteration = 4 status = {"expiration":"2024-09-09T17:45:23.430901575Z","pruned":[]}
55222024-09-09T17:55:23.442ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33845, tv_nsec: 46958105 } })
55232024-09-09T17:55:23.444ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
55242024-09-09T17:55:23.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55252024-09-09T17:55:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
55262024-09-09T17:55:23.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55272024-09-09T17:55:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55282024-09-09T17:55:23.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55292024-09-09T17:55:23.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
55302024-09-09T17:55:23.452ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55312024-09-09T17:55:23.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55322024-09-09T17:55:23.455ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55332024-09-09T17:55:23.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55342024-09-09T17:55:23.458ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55352024-09-09T17:55:23.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55362024-09-09T17:55:23.461ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55372024-09-09T17:55:23.461ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55382024-09-09T17:55:23.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55392024-09-09T17:55:23.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55402024-09-09T17:55:23.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55412024-09-09T17:55:23.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55422024-09-09T17:55:23.475ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55432024-09-09T17:55:23.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55442024-09-09T17:55:23.485ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55452024-09-09T17:55:23.485ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 53.899826ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55462024-09-09T17:55:23.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55472024-09-09T17:55:23.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55482024-09-09T17:55:23.494ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55492024-09-09T17:55:23.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55502024-09-09T17:55:23.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.795855ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
55512024-09-09T17:55:23.502ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
55522024-09-09T17:55:23.502ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55532024-09-09T17:55:23.502ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55542024-09-09T17:55:23.502ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55552024-09-09T17:55:23.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55562024-09-09T17:55:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
55572024-09-09T17:55:23.506ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55582024-09-09T17:55:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55592024-09-09T17:55:23.507ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55602024-09-09T17:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55612024-09-09T17:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55622024-09-09T17:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55632024-09-09T17:55:23.513ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55642024-09-09T17:55:23.514ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55652024-09-09T17:55:23.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55662024-09-09T17:55:23.514ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55672024-09-09T17:55:23.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 84.404675ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
55682024-09-09T17:55:23.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55692024-09-09T17:55:23.516ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55702024-09-09T17:55:23.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55712024-09-09T17:55:23.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55722024-09-09T17:55:23.517ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55732024-09-09T17:55:23.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55742024-09-09T17:55:23.519ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55752024-09-09T17:55:23.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55762024-09-09T17:55:23.520ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55772024-09-09T17:55:23.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55782024-09-09T17:55:23.521ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55792024-09-09T17:55:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55802024-09-09T17:55:23.521ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55812024-09-09T17:55:23.522ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55822024-09-09T17:55:23.522ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55832024-09-09T17:55:23.522ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33845, tv_nsec: 126887893 } })
55842024-09-09T17:55:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55852024-09-09T17:55:23.523ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
55862024-09-09T17:55:23.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55872024-09-09T17:55:23.524ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55882024-09-09T17:55:23.524ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
55892024-09-09T17:55:23.524ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
55902024-09-09T17:55:23.524ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
55912024-09-09T17:55:23.524ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55922024-09-09T17:55:23.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55932024-09-09T17:55:23.524ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55942024-09-09T17:55:23.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55952024-09-09T17:55:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
55962024-09-09T17:55:23.525ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
55972024-09-09T17:55:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
55982024-09-09T17:55:23.526ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
55992024-09-09T17:55:23.526ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
56002024-09-09T17:55:23.526ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
56012024-09-09T17:55:23.526ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56022024-09-09T17:55:23.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
56032024-09-09T17:55:23.526ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
56042024-09-09T17:55:23.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56052024-09-09T17:55:23.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
56062024-09-09T17:55:23.528ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 97.154779ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56072024-09-09T17:55:23.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56082024-09-09T17:55:23.528ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.697232ms iteration = 7 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
56092024-09-09T17:55:23.530ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56102024-09-09T17:55:23.531ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56112024-09-09T17:55:23.531ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56122024-09-09T17:55:23.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56132024-09-09T17:55:23.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56142024-09-09T17:55:23.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56152024-09-09T17:55:23.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56162024-09-09T17:55:23.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56172024-09-09T17:55:23.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56182024-09-09T17:55:23.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56192024-09-09T17:55:23.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56202024-09-09T17:55:23.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56212024-09-09T17:55:23.540ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56222024-09-09T17:55:23.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56232024-09-09T17:55:23.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56242024-09-09T17:55:23.541ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 109.928073ms iteration = 3 status = {"nsuccess":5}
56252024-09-09T17:55:23.541ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
56262024-09-09T17:55:23.541ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 0 version = 2
56272024-09-09T17:55:23.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56282024-09-09T17:55:23.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56292024-09-09T17:55:23.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56302024-09-09T17:55:23.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56312024-09-09T17:55:23.546ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56322024-09-09T17:55:23.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56332024-09-09T17:55:23.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56342024-09-09T17:55:23.548ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 1 version = 2
56352024-09-09T17:55:23.548ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
56362024-09-09T17:55:23.548ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-09 17:52:54.528560 UTC dns_group = external generation = 2
56372024-09-09T17:55:23.548ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 117.648449ms iteration = 5 status = {"generation":2}
56382024-09-09T17:55:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
56392024-09-09T17:55:23.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56402024-09-09T17:55:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56412024-09-09T17:55:23.555ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56422024-09-09T17:55:23.558ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
56432024-09-09T17:55:23.558ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56442024-09-09T17:55:23.559ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dd52b197-a4b0-4d78-8891-d84bdf8733a4", "content-length": "26", "date": "Mon, 09 Sep 2024 17:55:23 GMT"} })
56452024-09-09T17:55:23.559ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56462024-09-09T17:55:23.559ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 128.12421ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
56472024-09-09T17:55:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
56482024-09-09T17:55:23.560ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56492024-09-09T17:55:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56502024-09-09T17:55:23.561ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56512024-09-09T17:55:23.562ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
56522024-09-09T17:55:23.562ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 131.41026ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
56532024-09-09T17:55:23.563ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
56542024-09-09T17:55:23.563ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
56552024-09-09T17:55:23.563ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 132.179714ms iteration = 7 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
56562024-09-09T17:55:23.565ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
56572024-09-09T17:55:23.573ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 142.451464ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
56582024-09-09T17:55:23.578ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
56592024-09-09T17:55:23.578ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
56602024-09-09T17:55:23.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56612024-09-09T17:55:23.578ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
56622024-09-09T17:55:23.578ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
56632024-09-09T17:55:23.578ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 147.196473ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
56642024-09-09T17:55:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56652024-09-09T17:55:23.579ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
56662024-09-09T17:55:23.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56672024-09-09T17:55:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56682024-09-09T17:55:23.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56692024-09-09T17:55:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56702024-09-09T17:55:23.585ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
56712024-09-09T17:55:23.585ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
56722024-09-09T17:55:23.585ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-09 17:52:53.875764 UTC dns_group = internal generation = 1
56732024-09-09T17:55:23.585ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 154.745477ms iteration = 5 status = {"generation":1}
56742024-09-09T17:55:23.587ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56752024-09-09T17:55:23.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56762024-09-09T17:55:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56772024-09-09T17:55:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56782024-09-09T17:55:23.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56792024-09-09T17:55:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56802024-09-09T17:55:23.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56812024-09-09T17:55:23.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56822024-09-09T17:55:23.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56832024-09-09T17:55:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
56842024-09-09T17:55:23.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56852024-09-09T17:55:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56862024-09-09T17:55:23.597ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56872024-09-09T17:55:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56882024-09-09T17:55:23.597ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56892024-09-09T17:55:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56902024-09-09T17:55:23.598ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 166.926558ms iteration = 7 status = 0
56912024-09-09T17:55:23.599ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
56922024-09-09T17:55:23.599ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56932024-09-09T17:55:23.599ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bc1eee1e-ea47-4c08-bf0c-f34e7f984b98", "content-length": "26", "date": "Mon, 09 Sep 2024 17:55:23 GMT"} })
56942024-09-09T17:55:23.599ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56952024-09-09T17:55:23.599ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56962024-09-09T17:55:23.601ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
56972024-09-09T17:55:23.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56982024-09-09T17:55:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56992024-09-09T17:55:23.602ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57002024-09-09T17:55:23.630ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57012024-09-09T17:55:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57022024-09-09T17:55:23.632ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57032024-09-09T17:55:23.633ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57042024-09-09T17:55:23.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57052024-09-09T17:55:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57062024-09-09T17:55:23.634ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-09T17:52:21.456201Z, time_modified: 2024-09-09T17:52:21.456201Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }) }
57072024-09-09T17:55:23.634ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 203.18158ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]}},"default_endpoint":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
57082024-09-09T17:55:23.635ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57092024-09-09T17:55:23.637ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57102024-09-09T17:55:23.637ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57112024-09-09T17:55:23.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57122024-09-09T17:55:23.675ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f zone_address = fd00:1122:3344:101::2
57132024-09-09T17:55:23.675ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57142024-09-09T17:55:23.675ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "00b721fd-ae42-4d61-a011-03e0ebd27b78", "content-length": "26", "date": "Mon, 09 Sep 2024 17:55:23 GMT"} })
57152024-09-09T17:55:23.675ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57162024-09-09T17:55:23.678ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
57172024-09-09T17:55:23.686ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 254.787153ms iteration = 9 status = {"physical_disks_added":0}
57182024-09-09T17:55:23.695ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 264.971552ms iteration = 7 status = {}
57192024-09-09T17:55:23.737ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
57202024-09-09T17:55:23.756ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57212024-09-09T17:55:23.756ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7461d1bc-d2f0-4fc0-bf16-90eb7ed9170d", "content-length": "372", "date": "Mon, 09 Sep 2024 17:55:23 GMT"} })
57222024-09-09T17:55:23.756ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57232024-09-09T17:55:23.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57242024-09-09T17:55:23.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57252024-09-09T17:55:23.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57262024-09-09T17:55:23.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57272024-09-09T17:55:23.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57282024-09-09T17:55:23.768ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57292024-09-09T17:55:23.770ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "21637a23-8dda-4e0c-94fc-7fbbe508a31e", "date": "Mon, 09 Sep 2024 17:55:23 GMT"} })
57302024-09-09T17:55:23.771ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 340.384234ms iteration = 8 status = {}
57312024-09-09T17:55:23.811ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
57322024-09-09T17:55:23.812ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "955aa13c-8848-4a62-82e0-44f4dcf0edc1", "date": "Mon, 09 Sep 2024 17:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57332024-09-09T17:55:23.812ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57342024-09-09T17:55:23.814ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2af9fca1-129c-4e4d-bb6b-fd2ae6953fb8", "date": "Mon, 09 Sep 2024 17:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57352024-09-09T17:55:23.814ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57362024-09-09T17:55:23.817ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57372024-09-09T17:55:23.817ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 386.272543ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
57382024-09-09T17:55:23.830ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
57392024-09-09T17:55:23.830ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a7b1d6f6-2f16-460c-8860-69de03f7c839", "content-length": "1", "date": "Mon, 09 Sep 2024 17:55:23 GMT"} })
57402024-09-09T17:55:23.832ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57412024-09-09T17:55:23.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57422024-09-09T17:55:23.835ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 404.172697ms iteration = 7 status = null
57432024-09-09T17:55:23.856ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
57442024-09-09T17:55:23.857ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "df03b094-d579-4acd-94a1-b596588f0ee3", "date": "Mon, 09 Sep 2024 17:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57452024-09-09T17:55:23.857ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57462024-09-09T17:55:23.858ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7b2a39a0-e575-400c-9224-986b2b120803", "date": "Mon, 09 Sep 2024 17:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57472024-09-09T17:55:23.859ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57482024-09-09T17:55:23.860ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "75ebb991-346e-492e-af59-47e0d21b7cf4", "date": "Mon, 09 Sep 2024 17:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57492024-09-09T17:55:23.861ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57502024-09-09T17:55:23.863ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57512024-09-09T17:55:23.863ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 432.502114ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
57522024-09-09T17:55:23.902ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57532024-09-09T17:55:23.903ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7e0d7d10-b115-4c52-a09c-3f8c3fba18a0", "content-length": "691", "date": "Mon, 09 Sep 2024 17:55:23 GMT"} })
57542024-09-09T17:55:23.903ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
57552024-09-09T17:55:23.903ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
57562024-09-09T17:55:23.903ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
57572024-09-09T17:55:23.904ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 473.811056ms iteration = 7 status = {}
57582024-09-09T17:55:23.924ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57592024-09-09T17:55:23.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57602024-09-09T17:55:23.927ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 8ddbbc53-8b49-46f3-8c46-10ed4300f6d2, rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e) } rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
57612024-09-09T17:55:23.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57622024-09-09T17:55:23.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57632024-09-09T17:55:23.937ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
57642024-09-09T17:55:23.938ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2a57e0e4-6e7e-4ec8-b34c-c00049182c4c", "content-length": "121", "date": "Mon, 09 Sep 2024 17:55:23 GMT"} })
57652024-09-09T17:55:23.938ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
57662024-09-09T17:55:23.938ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e
57672024-09-09T17:55:23.938ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57682024-09-09T17:55:23.938ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57692024-09-09T17:55:23.938ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
57702024-09-09T17:55:23.938ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
57712024-09-09T17:55:23.938ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
57722024-09-09T17:55:23.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57732024-09-09T17:55:23.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57742024-09-09T17:55:23.940ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
57752024-09-09T17:55:23.940ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6600ef6b-66ac-4310-a106-b84f25b0730d", "content-length": "2", "date": "Mon, 09 Sep 2024 17:55:23 GMT"} })
57762024-09-09T17:55:23.940ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
57772024-09-09T17:55:23.940ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a85b89cd-5513-4d43-ad01-357496fdf969", "content-length": "51", "date": "Mon, 09 Sep 2024 17:55:23 GMT"} })
57782024-09-09T17:55:23.940ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
57792024-09-09T17:55:23.940ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57802024-09-09T17:55:24.044ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3a72e51b-a23e-45c8-9a97-29b3817cf100", "date": "Mon, 09 Sep 2024 17:55:23 GMT"} })
57812024-09-09T17:55:24.044ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch = Switch0
57822024-09-09T17:55:24.044ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57832024-09-09T17:55:24.132ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f9a56da7-aad0-4b13-8af9-900e3c347fee", "content-length": "667", "date": "Mon, 09 Sep 2024 17:55:24 GMT"} })
57842024-09-09T17:55:24.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57852024-09-09T17:55:24.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57862024-09-09T17:55:24.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57872024-09-09T17:55:24.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57882024-09-09T17:55:24.141ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57892024-09-09T17:55:24.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57902024-09-09T17:55:24.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57912024-09-09T17:55:24.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57922024-09-09T17:55:24.149ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 718.45777ms iteration = 7 status = {}
57932024-09-09T17:55:25.508ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
57942024-09-09T17:55:25.508ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
57952024-09-09T17:55:25.538ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
57962024-09-09T17:55:25.539ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:59387
57972024-09-09T17:55:25.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59387 req_id = a428f694-d0fe-48d4-a39a-8b799589f218 roles = RoleSet { roles: {} } uri = /metrics/producers
57982024-09-09T17:55:25.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59387 req_id = a428f694-d0fe-48d4-a39a-8b799589f218 resource = Database result = Ok(()) uri = /metrics/producers
57992024-09-09T17:55:25.540ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1341 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 60d05ccb-d36e-4e48-86af-a7b10edcc659 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
58002024-09-09T17:55:25.571ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
58012024-09-09T17:55:25.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59387 req_id = a428f694-d0fe-48d4-a39a-8b799589f218 roles = RoleSet { roles: {} } uri = /metrics/producers
58022024-09-09T17:55:25.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59387 req_id = a428f694-d0fe-48d4-a39a-8b799589f218 resource = Database result = Ok(()) uri = /metrics/producers
58032024-09-09T17:55:25.577ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
58042024-09-09T17:55:25.578ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c6757a0e-692c-424f-9071-6282a888944b", "date": "Mon, 09 Sep 2024 17:55:25 GMT"} })
58052024-09-09T17:55:25.578ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
58062024-09-09T17:55:25.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40247 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59387 req_id = a428f694-d0fe-48d4-a39a-8b799589f218 response_code = 201 uri = /metrics/producers
58072024-09-09T17:55:25.579ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "a428f694-d0fe-48d4-a39a-8b799589f218", "content-length": "41", "date": "Mon, 09 Sep 2024 17:55:25 GMT"} })
58082024-09-09T17:55:25.581ZDEBGnexus (producer-registration-task): registered with nexus successfully
58092024-09-09T17:55:25.581ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
58102024-09-09T17:55:26.590ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:44402
58112024-09-09T17:55:26.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44402 req_id = e1533f2b-1347-4a0a-9d3d-ffbacb67ee5d roles = RoleSet { roles: {} } uri = /metrics/producers
58122024-09-09T17:55:26.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44402 req_id = e1533f2b-1347-4a0a-9d3d-ffbacb67ee5d resource = Database result = Ok(()) uri = /metrics/producers
58132024-09-09T17:55:26.624ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
58142024-09-09T17:55:26.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44402 req_id = e1533f2b-1347-4a0a-9d3d-ffbacb67ee5d roles = RoleSet { roles: {} } uri = /metrics/producers
58152024-09-09T17:55:26.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44402 req_id = e1533f2b-1347-4a0a-9d3d-ffbacb67ee5d resource = Database result = Ok(()) uri = /metrics/producers
58162024-09-09T17:55:26.670ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
58172024-09-09T17:55:26.670ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6019adf1-40fc-4f19-b55d-f5543cdb38b5", "date": "Mon, 09 Sep 2024 17:55:26 GMT"} })
58182024-09-09T17:55:26.670ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 283b8781-e2cd-4d76-a776-70a483efe054
58192024-09-09T17:55:26.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 81220 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44402 req_id = e1533f2b-1347-4a0a-9d3d-ffbacb67ee5d response_code = 201 uri = /metrics/producers
58202024-09-09T17:55:33.430ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
58212024-09-09T17:55:33.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58222024-09-09T17:55:33.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58232024-09-09T17:55:33.431ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
58242024-09-09T17:55:33.431ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58252024-09-09T17:55:33.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58262024-09-09T17:55:33.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58272024-09-09T17:55:33.435ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58282024-09-09T17:55:33.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58292024-09-09T17:55:33.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58302024-09-09T17:55:33.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58312024-09-09T17:55:33.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58322024-09-09T17:55:33.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58332024-09-09T17:55:33.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
58342024-09-09T17:55:33.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58352024-09-09T17:55:33.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58362024-09-09T17:55:33.450ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
58372024-09-09T17:55:33.450ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.504064ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
58382024-09-09T17:55:33.458ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58392024-09-09T17:55:33.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58402024-09-09T17:55:33.484ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.702145ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58412024-09-09T17:55:35.580ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1163 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = d1d274ae-c5c9-44cf-a22e-16fd696cd851 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
58422024-09-09T17:55:43.430ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
58432024-09-09T17:55:43.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58442024-09-09T17:55:43.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58452024-09-09T17:55:43.431ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
58462024-09-09T17:55:43.431ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58472024-09-09T17:55:43.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58482024-09-09T17:55:43.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58492024-09-09T17:55:43.433ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58502024-09-09T17:55:43.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58512024-09-09T17:55:43.435ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.808593ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58522024-09-09T17:55:43.435ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58532024-09-09T17:55:43.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58542024-09-09T17:55:43.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58552024-09-09T17:55:43.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58562024-09-09T17:55:43.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58572024-09-09T17:55:43.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58582024-09-09T17:55:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
58592024-09-09T17:55:43.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58602024-09-09T17:55:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58612024-09-09T17:55:43.447ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
58622024-09-09T17:55:43.447ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.365586ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
58632024-09-09T17:55:45.580ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1194 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = db750e80-ebbe-433b-b5be-5cb4820093f2 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
58642024-09-09T17:55:52.011ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:32906
58652024-09-09T17:55:52.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:32906 req_id = 43782a67-3ccc-4a9a-b2c7-4e4fdbc46bda roles = RoleSet { roles: {} } uri = /metrics/producers
58662024-09-09T17:55:52.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:32906 req_id = 43782a67-3ccc-4a9a-b2c7-4e4fdbc46bda resource = Database result = Ok(()) uri = /metrics/producers
58672024-09-09T17:55:52.043ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
58682024-09-09T17:55:52.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:32906 req_id = 43782a67-3ccc-4a9a-b2c7-4e4fdbc46bda roles = RoleSet { roles: {} } uri = /metrics/producers
58692024-09-09T17:55:52.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:32906 req_id = 43782a67-3ccc-4a9a-b2c7-4e4fdbc46bda resource = Database result = Ok(()) uri = /metrics/producers
58702024-09-09T17:55:52.049ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
58712024-09-09T17:55:52.050ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a802e356-0538-4f55-9e3d-7bf8228f2647", "date": "Mon, 09 Sep 2024 17:55:52 GMT"} })
58722024-09-09T17:55:52.050ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 1b80eb26-d978-4b89-a5d7-a50775a95a33
58732024-09-09T17:55:52.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40720 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:32906 req_id = 43782a67-3ccc-4a9a-b2c7-4e4fdbc46bda response_code = 201 uri = /metrics/producers
58742024-09-09T17:55:53.431ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
58752024-09-09T17:55:53.431ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
58762024-09-09T17:55:53.431ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58772024-09-09T17:55:53.431ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
58782024-09-09T17:55:53.431ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
58792024-09-09T17:55:53.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58802024-09-09T17:55:53.431ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58812024-09-09T17:55:53.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58822024-09-09T17:55:53.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58832024-09-09T17:55:53.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58842024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
58852024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
58862024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58872024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58882024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
58892024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58902024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58912024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
58922024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58932024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
58942024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
58952024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58962024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58972024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
58982024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58992024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
59002024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59012024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
59022024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
59032024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
59042024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59052024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59062024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59072024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
59082024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59092024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
59102024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59112024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
59122024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59132024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
59142024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59152024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59162024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59172024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59182024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59192024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59202024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59212024-09-09T17:55:53.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59222024-09-09T17:55:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59232024-09-09T17:55:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59242024-09-09T17:55:53.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59252024-09-09T17:55:53.434ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33875, tv_nsec: 38223308 } })
59262024-09-09T17:55:53.435ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.912153ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
59272024-09-09T17:55:53.435ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
59282024-09-09T17:55:53.435ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33875, tv_nsec: 39208334 } })
59292024-09-09T17:55:53.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59302024-09-09T17:55:53.436ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
59312024-09-09T17:55:53.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59322024-09-09T17:55:53.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59332024-09-09T17:55:53.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59342024-09-09T17:55:53.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59352024-09-09T17:55:53.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59362024-09-09T17:55:53.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59372024-09-09T17:55:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59382024-09-09T17:55:53.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59392024-09-09T17:55:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59402024-09-09T17:55:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
59412024-09-09T17:55:53.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59422024-09-09T17:55:53.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
59432024-09-09T17:55:53.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59442024-09-09T17:55:53.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59452024-09-09T17:55:53.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59462024-09-09T17:55:53.443ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59472024-09-09T17:55:53.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59482024-09-09T17:55:53.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59492024-09-09T17:55:53.443ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59502024-09-09T17:55:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
59512024-09-09T17:55:53.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59522024-09-09T17:55:53.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59532024-09-09T17:55:53.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59542024-09-09T17:55:53.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59552024-09-09T17:55:53.452ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33875, tv_nsec: 56002832 } })
59562024-09-09T17:55:53.452ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59572024-09-09T17:55:53.452ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
59582024-09-09T17:55:53.454ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59592024-09-09T17:55:53.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59602024-09-09T17:55:53.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59612024-09-09T17:55:53.456ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59622024-09-09T17:55:53.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59632024-09-09T17:55:53.460ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59642024-09-09T17:55:53.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59652024-09-09T17:55:53.463ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59662024-09-09T17:55:53.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59672024-09-09T17:55:53.465ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59682024-09-09T17:55:53.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59692024-09-09T17:55:53.483ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.738517ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
59702024-09-09T17:55:53.483ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 51.29046ms iteration = 10 status = {"physical_disks_added":0}
59712024-09-09T17:55:53.486ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.937766ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
59722024-09-09T17:55:53.486ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
59732024-09-09T17:55:53.486ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
59742024-09-09T17:55:53.486ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59752024-09-09T17:55:53.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59762024-09-09T17:55:53.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59772024-09-09T17:55:53.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59782024-09-09T17:55:53.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59792024-09-09T17:55:53.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
59802024-09-09T17:55:53.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59812024-09-09T17:55:53.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59822024-09-09T17:55:53.498ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59832024-09-09T17:55:53.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59842024-09-09T17:55:53.499ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59852024-09-09T17:55:53.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59862024-09-09T17:55:53.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59872024-09-09T17:55:53.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59882024-09-09T17:55:53.501ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59892024-09-09T17:55:53.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59902024-09-09T17:55:53.503ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59912024-09-09T17:55:53.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59922024-09-09T17:55:53.505ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59932024-09-09T17:55:53.507ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
59942024-09-09T17:55:53.508ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.673119ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
59952024-09-09T17:55:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
59962024-09-09T17:55:53.508ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59972024-09-09T17:55:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59982024-09-09T17:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59992024-09-09T17:55:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60002024-09-09T17:55:53.510ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 77.869976ms iteration = 8 status = 0
60012024-09-09T17:55:53.511ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.64089ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
60022024-09-09T17:55:53.519ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
60032024-09-09T17:55:53.519ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
60042024-09-09T17:55:53.519ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 86.766759ms iteration = 8 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
60052024-09-09T17:55:53.528ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 96.505536ms iteration = 8 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
60062024-09-09T17:55:53.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60072024-09-09T17:55:53.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60082024-09-09T17:55:53.532ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.238977ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60092024-09-09T17:55:53.542ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
60102024-09-09T17:55:53.542ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60112024-09-09T17:55:53.543ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3a7948f4-1993-47b4-8e86-c9059156139a", "content-length": "26", "date": "Mon, 09 Sep 2024 17:55:53 GMT"} })
60122024-09-09T17:55:53.543ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60132024-09-09T17:55:53.544ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
60142024-09-09T17:55:53.544ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 111.698285ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
60152024-09-09T17:55:53.545ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60162024-09-09T17:55:53.557ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 125.166313ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
60172024-09-09T17:55:53.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60182024-09-09T17:55:53.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60192024-09-09T17:55:53.609ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60202024-09-09T17:55:53.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60212024-09-09T17:55:53.612ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60222024-09-09T17:55:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60232024-09-09T17:55:53.613ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60242024-09-09T17:55:53.616ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60252024-09-09T17:55:53.616ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60262024-09-09T17:55:53.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60272024-09-09T17:55:53.634ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
60282024-09-09T17:55:53.634ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60292024-09-09T17:55:53.635ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "766c7879-edcc-48b6-875a-b49258bc7979", "content-length": "26", "date": "Mon, 09 Sep 2024 17:55:53 GMT"} })
60302024-09-09T17:55:53.635ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60312024-09-09T17:55:53.638ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60322024-09-09T17:55:53.656ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f zone_address = fd00:1122:3344:101::2
60332024-09-09T17:55:53.656ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60342024-09-09T17:55:53.656ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e71b6a41-19c3-4e03-9f5f-19e7df7d735c", "content-length": "26", "date": "Mon, 09 Sep 2024 17:55:53 GMT"} })
60352024-09-09T17:55:53.656ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60362024-09-09T17:55:53.658ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
60372024-09-09T17:55:53.687ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60382024-09-09T17:55:53.687ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c86ca09d-0669-40c8-9017-bdd4228a8d04", "content-length": "372", "date": "Mon, 09 Sep 2024 17:55:53 GMT"} })
60392024-09-09T17:55:53.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60402024-09-09T17:55:53.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60412024-09-09T17:55:53.689ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
60422024-09-09T17:55:53.689ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ba0c96e1-8684-4ca5-9fc8-2c0ba43ba038", "content-length": "1", "date": "Mon, 09 Sep 2024 17:55:53 GMT"} })
60432024-09-09T17:55:53.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60442024-09-09T17:55:53.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60452024-09-09T17:55:53.690ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60462024-09-09T17:55:53.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60472024-09-09T17:55:53.693ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60482024-09-09T17:55:53.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60492024-09-09T17:55:53.730ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
60502024-09-09T17:55:53.731ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d0c76419-8d2b-4723-958b-f9a58bfe915f", "content-length": "691", "date": "Mon, 09 Sep 2024 17:55:53 GMT"} })
60512024-09-09T17:55:53.731ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
60522024-09-09T17:55:53.731ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
60532024-09-09T17:55:53.731ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
60542024-09-09T17:55:53.732ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 301.307675ms iteration = 8 status = null
60552024-09-09T17:55:53.733ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 300.930433ms iteration = 8 status = {}
60562024-09-09T17:55:53.733ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60572024-09-09T17:55:53.734ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2b01e116-5126-4766-a9ff-7f5fb59fc990", "date": "Mon, 09 Sep 2024 17:55:53 GMT"} })
60582024-09-09T17:55:53.735ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 303.450968ms iteration = 9 status = {}
60592024-09-09T17:55:53.743ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 312.036428ms iteration = 8 status = {}
60602024-09-09T17:55:53.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60612024-09-09T17:55:53.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60622024-09-09T17:55:53.828ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 8ddbbc53-8b49-46f3-8c46-10ed4300f6d2, rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e) } rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
60632024-09-09T17:55:53.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60642024-09-09T17:55:53.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60652024-09-09T17:55:53.838ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60662024-09-09T17:55:53.838ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "89670747-d77a-4111-a380-a50c5a6787b2", "content-length": "121", "date": "Mon, 09 Sep 2024 17:55:53 GMT"} })
60672024-09-09T17:55:53.838ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
60682024-09-09T17:55:53.838ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e
60692024-09-09T17:55:53.839ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60702024-09-09T17:55:53.839ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60712024-09-09T17:55:53.839ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
60722024-09-09T17:55:53.839ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
60732024-09-09T17:55:53.839ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
60742024-09-09T17:55:53.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60752024-09-09T17:55:53.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60762024-09-09T17:55:53.841ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60772024-09-09T17:55:53.841ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9a5dde20-27ca-4ba0-a995-93f7ece47637", "content-length": "2", "date": "Mon, 09 Sep 2024 17:55:53 GMT"} })
60782024-09-09T17:55:53.841ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60792024-09-09T17:55:53.841ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "67fdac3e-1a1f-45fc-a5a8-62864238270b", "content-length": "51", "date": "Mon, 09 Sep 2024 17:55:53 GMT"} })
60802024-09-09T17:55:53.841ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
60812024-09-09T17:55:53.841ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60822024-09-09T17:55:54.035ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "eeafeb69-6786-4371-8eec-2d3e91e83eed", "date": "Mon, 09 Sep 2024 17:55:53 GMT"} })
60832024-09-09T17:55:54.035ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch = Switch0
60842024-09-09T17:55:54.035ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60852024-09-09T17:55:54.035ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b98f6190-8b8a-428e-979a-c0e2a18769b7", "content-length": "667", "date": "Mon, 09 Sep 2024 17:55:53 GMT"} })
60862024-09-09T17:55:54.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60872024-09-09T17:55:54.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60882024-09-09T17:55:54.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60892024-09-09T17:55:54.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60902024-09-09T17:55:54.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60912024-09-09T17:55:54.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60922024-09-09T17:55:54.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60932024-09-09T17:55:54.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60942024-09-09T17:55:54.053ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 621.35538ms iteration = 8 status = {}
60952024-09-09T17:55:55.581ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1606 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 4d8fc6ba-5e26-4a3b-be57-2f8ff866085c response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
60962024-09-09T17:56:03.431ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
60972024-09-09T17:56:03.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60982024-09-09T17:56:03.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60992024-09-09T17:56:03.432ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
61002024-09-09T17:56:03.432ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61012024-09-09T17:56:03.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61022024-09-09T17:56:03.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61032024-09-09T17:56:03.433ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61042024-09-09T17:56:03.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61052024-09-09T17:56:03.435ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.857433ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61062024-09-09T17:56:03.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61072024-09-09T17:56:03.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61082024-09-09T17:56:03.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61092024-09-09T17:56:03.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61102024-09-09T17:56:03.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61112024-09-09T17:56:03.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61122024-09-09T17:56:03.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
61132024-09-09T17:56:03.467ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61142024-09-09T17:56:03.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61152024-09-09T17:56:03.476ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
61162024-09-09T17:56:03.476ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.155364ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
61172024-09-09T17:56:05.581ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1371 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 4323b2c5-0fdf-47fd-8339-e7480795cdd6 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
61182024-09-09T17:56:13.431ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
61192024-09-09T17:56:13.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61202024-09-09T17:56:13.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61212024-09-09T17:56:13.432ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
61222024-09-09T17:56:13.432ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61232024-09-09T17:56:13.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61242024-09-09T17:56:13.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61252024-09-09T17:56:13.434ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61262024-09-09T17:56:13.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61272024-09-09T17:56:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61282024-09-09T17:56:13.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61292024-09-09T17:56:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61302024-09-09T17:56:13.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.907363ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61312024-09-09T17:56:13.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61322024-09-09T17:56:13.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61332024-09-09T17:56:13.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61342024-09-09T17:56:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
61352024-09-09T17:56:13.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61362024-09-09T17:56:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61372024-09-09T17:56:13.448ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
61382024-09-09T17:56:13.448ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.471966ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
61392024-09-09T17:56:15.581ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1123 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = dc5100cd-0c2f-43b2-931b-551650ef6b1f response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
61402024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
61412024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
61422024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61432024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
61442024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
61452024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61462024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
61472024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
61482024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61492024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61502024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
61512024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61522024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
61532024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
61542024-09-09T17:56:23.431ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b
61552024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.03\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b"}
61562024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
61572024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
61582024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
61592024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61602024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
61612024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
61622024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
61632024-09-09T17:56:23.431ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-09 17:46:23.431750980 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
61642024-09-09T17:56:23.431ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
61652024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61662024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61672024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61682024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61692024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61702024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
61712024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61722024-09-09T17:56:23.432ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("21f5073c-362d-497d-ae9e-f6ab85374703.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("42b0964a-b1a3-443e-b006-c18e1ad8d003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 33905, tv_nsec: 35240403 } })
61732024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
61742024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
61752024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
61762024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61772024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61782024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61792024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
61802024-09-09T17:56:23.432ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
61812024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
61822024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61832024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61842024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
61852024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61862024-09-09T17:56:23.432ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("07c1bbdd-f080-4837-9528-41234be47bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 33905, tv_nsec: 35472175 } })
61872024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
61882024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
61892024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61902024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61912024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
61922024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
61932024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
61942024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61952024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
61962024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
61972024-09-09T17:56:23.432ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
61982024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61992024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
62002024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
62012024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62022024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
62032024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62042024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
62052024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62062024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
62072024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62082024-09-09T17:56:23.432ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62092024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62102024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62112024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62122024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62132024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62142024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62152024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62162024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62172024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62182024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62192024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
62202024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
62212024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62222024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62232024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62242024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62252024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62262024-09-09T17:56:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62272024-09-09T17:56:23.435ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
62282024-09-09T17:56:23.435ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.514651ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
62292024-09-09T17:56:23.435ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.862433ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62302024-09-09T17:56:23.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62312024-09-09T17:56:23.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62322024-09-09T17:56:23.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62332024-09-09T17:56:23.437ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
62342024-09-09T17:56:23.437ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.748714ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
62352024-09-09T17:56:23.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62362024-09-09T17:56:23.439ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-09 17:46:23.431750980 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
62372024-09-09T17:56:23.439ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.408333ms iteration = 5 status = {"expiration":"2024-09-09T17:46:23.431750980Z","pruned":[]}
62382024-09-09T17:56:23.440ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33905, tv_nsec: 42828058 } })
62392024-09-09T17:56:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62402024-09-09T17:56:23.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62412024-09-09T17:56:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62422024-09-09T17:56:23.440ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
62432024-09-09T17:56:23.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33905, tv_nsec: 44363197 } })
62442024-09-09T17:56:23.441ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62452024-09-09T17:56:23.441ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62462024-09-09T17:56:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62472024-09-09T17:56:23.442ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62482024-09-09T17:56:23.443ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
62492024-09-09T17:56:23.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62502024-09-09T17:56:23.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62512024-09-09T17:56:23.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62522024-09-09T17:56:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62532024-09-09T17:56:23.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62542024-09-09T17:56:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62552024-09-09T17:56:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62562024-09-09T17:56:23.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62572024-09-09T17:56:23.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62582024-09-09T17:56:23.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62592024-09-09T17:56:23.450ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62602024-09-09T17:56:23.451ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.944571ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
62612024-09-09T17:56:23.453ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62622024-09-09T17:56:23.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62632024-09-09T17:56:23.453ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
62642024-09-09T17:56:23.453ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
62652024-09-09T17:56:23.453ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.896593ms iteration = 5 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
62662024-09-09T17:56:23.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62672024-09-09T17:56:23.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62682024-09-09T17:56:23.453ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62692024-09-09T17:56:23.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62702024-09-09T17:56:23.457ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62712024-09-09T17:56:23.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 24.709095ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
62722024-09-09T17:56:23.458ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62732024-09-09T17:56:23.459ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62742024-09-09T17:56:23.460ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62752024-09-09T17:56:23.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62762024-09-09T17:56:23.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62772024-09-09T17:56:23.461ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62782024-09-09T17:56:23.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62792024-09-09T17:56:23.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62802024-09-09T17:56:23.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62812024-09-09T17:56:23.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62822024-09-09T17:56:23.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62832024-09-09T17:56:23.466ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
62842024-09-09T17:56:23.466ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
62852024-09-09T17:56:23.466ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
62862024-09-09T17:56:23.466ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62872024-09-09T17:56:23.466ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62882024-09-09T17:56:23.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62892024-09-09T17:56:23.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62902024-09-09T17:56:23.475ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62912024-09-09T17:56:23.477ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62922024-09-09T17:56:23.478ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33905, tv_nsec: 80952101 } })
62932024-09-09T17:56:23.478ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
62942024-09-09T17:56:23.479ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62952024-09-09T17:56:23.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62962024-09-09T17:56:23.480ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62972024-09-09T17:56:23.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62982024-09-09T17:56:23.481ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
62992024-09-09T17:56:23.481ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63002024-09-09T17:56:23.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63012024-09-09T17:56:23.482ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
63022024-09-09T17:56:23.482ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
63032024-09-09T17:56:23.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
63042024-09-09T17:56:23.483ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63052024-09-09T17:56:23.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63062024-09-09T17:56:23.483ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63072024-09-09T17:56:23.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63082024-09-09T17:56:23.488ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63092024-09-09T17:56:23.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63102024-09-09T17:56:23.490ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63112024-09-09T17:56:23.490ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 57.552347ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63122024-09-09T17:56:23.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63132024-09-09T17:56:23.491ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63142024-09-09T17:56:23.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63152024-09-09T17:56:23.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63162024-09-09T17:56:23.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63172024-09-09T17:56:23.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63182024-09-09T17:56:23.503ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
63192024-09-09T17:56:23.503ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63202024-09-09T17:56:23.503ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63212024-09-09T17:56:23.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63222024-09-09T17:56:23.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63232024-09-09T17:56:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63242024-09-09T17:56:23.510ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
63252024-09-09T17:56:23.510ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.60888ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
63262024-09-09T17:56:23.510ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.35099ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
63272024-09-09T17:56:23.513ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63282024-09-09T17:56:23.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63292024-09-09T17:56:23.520ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 87.590693ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
63302024-09-09T17:56:23.530ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63312024-09-09T17:56:23.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63322024-09-09T17:56:23.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63332024-09-09T17:56:23.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63342024-09-09T17:56:23.536ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
63352024-09-09T17:56:23.536ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
63362024-09-09T17:56:23.536ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
63372024-09-09T17:56:23.536ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 103.957039ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63382024-09-09T17:56:23.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63392024-09-09T17:56:23.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63402024-09-09T17:56:23.541ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63412024-09-09T17:56:23.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
63422024-09-09T17:56:23.546ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63432024-09-09T17:56:23.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63442024-09-09T17:56:23.548ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
63452024-09-09T17:56:23.548ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 0 version = 2
63462024-09-09T17:56:23.548ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63472024-09-09T17:56:23.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63482024-09-09T17:56:23.549ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
63492024-09-09T17:56:23.549ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
63502024-09-09T17:56:23.549ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 117.298207ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
63512024-09-09T17:56:23.556ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63522024-09-09T17:56:23.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63532024-09-09T17:56:23.558ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
63542024-09-09T17:56:23.558ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63552024-09-09T17:56:23.558ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 125.301624ms iteration = 9 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
63562024-09-09T17:56:23.561ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 128.749575ms iteration = 11 status = {"physical_disks_added":0}
63572024-09-09T17:56:23.601ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
63582024-09-09T17:56:23.605ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
63592024-09-09T17:56:23.605ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63602024-09-09T17:56:23.605ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "774a77ec-78d4-4291-897a-c49e6464bfed", "content-length": "26", "date": "Mon, 09 Sep 2024 17:56:23 GMT"} })
63612024-09-09T17:56:23.605ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63622024-09-09T17:56:23.605ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
63632024-09-09T17:56:23.607ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63642024-09-09T17:56:23.614ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
63652024-09-09T17:56:23.614ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63662024-09-09T17:56:23.614ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "66c29201-2a5c-4554-ab60-cae4098b198d", "content-length": "26", "date": "Mon, 09 Sep 2024 17:56:23 GMT"} })
63672024-09-09T17:56:23.614ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63682024-09-09T17:56:23.615ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63692024-09-09T17:56:23.754ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63702024-09-09T17:56:23.755ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b7ce43b8-ae10-49a3-a33e-5122822cfcbc", "content-length": "1", "date": "Mon, 09 Sep 2024 17:56:23 GMT"} })
63712024-09-09T17:56:23.756ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63722024-09-09T17:56:23.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63732024-09-09T17:56:23.777ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f zone_address = fd00:1122:3344:101::2
63742024-09-09T17:56:23.777ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63752024-09-09T17:56:23.777ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "63ff4b09-5439-408c-be35-62612877905f", "content-length": "26", "date": "Mon, 09 Sep 2024 17:56:23 GMT"} })
63762024-09-09T17:56:23.777ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63772024-09-09T17:56:23.779ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
63782024-09-09T17:56:23.792ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 360.730473ms iteration = 9 status = {}
63792024-09-09T17:56:23.793ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
63802024-09-09T17:56:23.794ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63812024-09-09T17:56:23.795ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5a84e7b1-6f4a-4ffa-aa59-cb15617b0b64", "date": "Mon, 09 Sep 2024 17:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63822024-09-09T17:56:23.795ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63832024-09-09T17:56:23.795ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "830bcf8e-fa49-477f-acfb-b3c7d199bc39", "content-length": "372", "date": "Mon, 09 Sep 2024 17:56:23 GMT"} })
63842024-09-09T17:56:23.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63852024-09-09T17:56:23.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63862024-09-09T17:56:23.798ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1bb089b8-cd34-4cc4-bee7-dd7322bb2dc5", "date": "Mon, 09 Sep 2024 17:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63872024-09-09T17:56:23.798ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63882024-09-09T17:56:23.798ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63892024-09-09T17:56:23.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63902024-09-09T17:56:23.800ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
63912024-09-09T17:56:23.800ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63922024-09-09T17:56:23.800ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 369.146053ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
63932024-09-09T17:56:23.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63942024-09-09T17:56:23.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63952024-09-09T17:56:23.803ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 372.033899ms iteration = 9 status = null
63962024-09-09T17:56:23.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63972024-09-09T17:56:23.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63982024-09-09T17:56:23.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63992024-09-09T17:56:23.805ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64002024-09-09T17:56:23.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64012024-09-09T17:56:23.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64022024-09-09T17:56:23.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64032024-09-09T17:56:23.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64042024-09-09T17:56:23.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64052024-09-09T17:56:23.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
64062024-09-09T17:56:23.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64072024-09-09T17:56:23.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64082024-09-09T17:56:23.811ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64092024-09-09T17:56:23.811ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 1 version = 2
64102024-09-09T17:56:23.811ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
64112024-09-09T17:56:23.811ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-09 17:52:54.528560 UTC dns_group = external generation = 2
64122024-09-09T17:56:23.811ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 380.394279ms iteration = 6 status = {"generation":2}
64132024-09-09T17:56:23.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64142024-09-09T17:56:23.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64152024-09-09T17:56:23.814ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 381.857347ms iteration = 9 status = 0
64162024-09-09T17:56:23.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64172024-09-09T17:56:23.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64182024-09-09T17:56:23.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64192024-09-09T17:56:23.823ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64202024-09-09T17:56:23.823ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "91342dd6-7f80-4ddf-a1b6-7bb37cf7d6bc", "date": "Mon, 09 Sep 2024 17:56:23 GMT"} })
64212024-09-09T17:56:23.826ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 393.891378ms iteration = 10 status = {}
64222024-09-09T17:56:23.847ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64232024-09-09T17:56:23.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64242024-09-09T17:56:23.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64252024-09-09T17:56:23.849ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64262024-09-09T17:56:23.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64272024-09-09T17:56:23.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 419.591248ms iteration = 9 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
64282024-09-09T17:56:23.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
64292024-09-09T17:56:23.852ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64302024-09-09T17:56:23.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64312024-09-09T17:56:23.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64322024-09-09T17:56:23.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64332024-09-09T17:56:23.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64342024-09-09T17:56:23.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64352024-09-09T17:56:23.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 421.458189ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
64362024-09-09T17:56:23.924ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64372024-09-09T17:56:23.925ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "250c7ba8-444d-43b1-b3f2-e8892d637180", "content-length": "691", "date": "Mon, 09 Sep 2024 17:56:23 GMT"} })
64382024-09-09T17:56:23.925ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
64392024-09-09T17:56:23.925ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
64402024-09-09T17:56:23.925ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
64412024-09-09T17:56:23.927ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 495.268971ms iteration = 9 status = {}
64422024-09-09T17:56:23.961ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-09T17:52:21.456201Z, time_modified: 2024-09-09T17:52:21.456201Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }) }
64432024-09-09T17:56:23.961ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 529.785924ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]}},"default_endpoint":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
64442024-09-09T17:56:23.962ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
64452024-09-09T17:56:23.962ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
64462024-09-09T17:56:23.962ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64472024-09-09T17:56:23.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64482024-09-09T17:56:23.963ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64492024-09-09T17:56:23.966ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
64502024-09-09T17:56:23.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64512024-09-09T17:56:23.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64522024-09-09T17:56:23.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64532024-09-09T17:56:23.967ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "db539eb6-01b3-4baf-8142-7eed61fad020", "date": "Mon, 09 Sep 2024 17:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64542024-09-09T17:56:23.967ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64552024-09-09T17:56:23.968ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "46069cdf-3382-4ea0-9c7d-0aa06a52912f", "date": "Mon, 09 Sep 2024 17:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64562024-09-09T17:56:23.968ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64572024-09-09T17:56:23.969ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
64582024-09-09T17:56:23.969ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
64592024-09-09T17:56:23.969ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-09 17:52:53.875764 UTC dns_group = internal generation = 1
64602024-09-09T17:56:23.969ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 537.547969ms iteration = 6 status = {"generation":1}
64612024-09-09T17:56:23.971ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "768d5b2d-8cd5-46cc-b231-bb2b9954857c", "date": "Mon, 09 Sep 2024 17:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64622024-09-09T17:56:23.971ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64632024-09-09T17:56:23.973ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64642024-09-09T17:56:23.973ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 541.788195ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
64652024-09-09T17:56:24.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64662024-09-09T17:56:24.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64672024-09-09T17:56:24.018ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 8ddbbc53-8b49-46f3-8c46-10ed4300f6d2, rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e) } rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
64682024-09-09T17:56:24.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64692024-09-09T17:56:24.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64702024-09-09T17:56:24.028ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64712024-09-09T17:56:24.028ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4c128ab8-2ac9-4404-a375-d5523ef2cf74", "content-length": "121", "date": "Mon, 09 Sep 2024 17:56:23 GMT"} })
64722024-09-09T17:56:24.028ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
64732024-09-09T17:56:24.028ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e
64742024-09-09T17:56:24.028ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64752024-09-09T17:56:24.028ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64762024-09-09T17:56:24.028ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
64772024-09-09T17:56:24.028ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
64782024-09-09T17:56:24.028ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
64792024-09-09T17:56:24.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64802024-09-09T17:56:24.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64812024-09-09T17:56:24.030ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64822024-09-09T17:56:24.030ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "50e9b871-1cc3-4558-8685-aef810e56d00", "content-length": "2", "date": "Mon, 09 Sep 2024 17:56:23 GMT"} })
64832024-09-09T17:56:24.031ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64842024-09-09T17:56:24.031ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5280570c-cdd3-43ca-b01d-681af6c12c10", "content-length": "51", "date": "Mon, 09 Sep 2024 17:56:23 GMT"} })
64852024-09-09T17:56:24.031ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
64862024-09-09T17:56:24.031ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64872024-09-09T17:56:24.226ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f722d344-574a-4546-a71d-708cfd6026b0", "date": "Mon, 09 Sep 2024 17:56:24 GMT"} })
64882024-09-09T17:56:24.226ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch = Switch0
64892024-09-09T17:56:24.226ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64902024-09-09T17:56:24.226ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f2104cc3-dfbd-4a23-b07c-0d37e7832eff", "content-length": "667", "date": "Mon, 09 Sep 2024 17:56:23 GMT"} })
64912024-09-09T17:56:24.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64922024-09-09T17:56:24.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64932024-09-09T17:56:24.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64942024-09-09T17:56:24.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64952024-09-09T17:56:24.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64962024-09-09T17:56:24.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64972024-09-09T17:56:24.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64982024-09-09T17:56:24.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64992024-09-09T17:56:24.242ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 809.938226ms iteration = 9 status = {}
65002024-09-09T17:56:25.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1106 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 5a986be1-4376-4f78-8ebb-79564a924595 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
65012024-09-09T17:56:33.431ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
65022024-09-09T17:56:33.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65032024-09-09T17:56:33.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65042024-09-09T17:56:33.433ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
65052024-09-09T17:56:33.433ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65062024-09-09T17:56:33.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65072024-09-09T17:56:33.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65082024-09-09T17:56:33.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65092024-09-09T17:56:33.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65102024-09-09T17:56:33.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65112024-09-09T17:56:33.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65122024-09-09T17:56:33.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65132024-09-09T17:56:33.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65142024-09-09T17:56:33.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
65152024-09-09T17:56:33.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65162024-09-09T17:56:33.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65172024-09-09T17:56:33.452ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
65182024-09-09T17:56:33.452ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.51466ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
65192024-09-09T17:56:33.460ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65202024-09-09T17:56:33.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65212024-09-09T17:56:33.461ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.866884ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65222024-09-09T17:56:35.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1722 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = b242a043-d80f-4ba2-92c0-5120105069b3 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
65232024-09-09T17:56:43.432ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
65242024-09-09T17:56:43.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65252024-09-09T17:56:43.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65262024-09-09T17:56:43.433ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
65272024-09-09T17:56:43.433ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65282024-09-09T17:56:43.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65292024-09-09T17:56:43.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65302024-09-09T17:56:43.434ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65312024-09-09T17:56:43.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65322024-09-09T17:56:43.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65332024-09-09T17:56:43.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65342024-09-09T17:56:43.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65352024-09-09T17:56:43.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.855893ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65362024-09-09T17:56:43.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65372024-09-09T17:56:43.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65382024-09-09T17:56:43.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65392024-09-09T17:56:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
65402024-09-09T17:56:43.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65412024-09-09T17:56:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65422024-09-09T17:56:43.453ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
65432024-09-09T17:56:43.453ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.070073ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
65442024-09-09T17:56:45.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1321 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 025eeac8-2491-418f-9940-fce6609e00a5 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
65452024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
65462024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
65472024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
65482024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65492024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
65502024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
65512024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
65522024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65532024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65542024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
65552024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
65562024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65572024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65582024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65592024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
65602024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65612024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
65622024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
65632024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65642024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
65652024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65662024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
65672024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65682024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65692024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
65702024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65712024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
65722024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65732024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
65742024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65752024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
65762024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65772024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
65782024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65792024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65802024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65812024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65822024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65832024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65842024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65852024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65862024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65872024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65882024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65892024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65902024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65912024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65922024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65932024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65942024-09-09T17:56:53.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65952024-09-09T17:56:53.435ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33935, tv_nsec: 38105442 } })
65962024-09-09T17:56:53.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65972024-09-09T17:56:53.436ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
65982024-09-09T17:56:53.436ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.809632ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
65992024-09-09T17:56:53.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66002024-09-09T17:56:53.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66012024-09-09T17:56:53.439ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33935, tv_nsec: 42088395 } })
66022024-09-09T17:56:53.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
66032024-09-09T17:56:53.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66042024-09-09T17:56:53.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66052024-09-09T17:56:53.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
66062024-09-09T17:56:53.441ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66072024-09-09T17:56:53.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66082024-09-09T17:56:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66092024-09-09T17:56:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66102024-09-09T17:56:53.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66112024-09-09T17:56:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66122024-09-09T17:56:53.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66132024-09-09T17:56:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66142024-09-09T17:56:53.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66152024-09-09T17:56:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66162024-09-09T17:56:53.453ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66172024-09-09T17:56:53.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66182024-09-09T17:56:53.455ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33935, tv_nsec: 57057303 } })
66192024-09-09T17:56:53.455ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
66202024-09-09T17:56:53.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66212024-09-09T17:56:53.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66222024-09-09T17:56:53.458ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66232024-09-09T17:56:53.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66242024-09-09T17:56:53.463ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66252024-09-09T17:56:53.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66262024-09-09T17:56:53.467ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66272024-09-09T17:56:53.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66282024-09-09T17:56:53.483ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
66292024-09-09T17:56:53.483ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66302024-09-09T17:56:53.483ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66312024-09-09T17:56:53.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66322024-09-09T17:56:53.484ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66332024-09-09T17:56:53.487ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66342024-09-09T17:56:53.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66352024-09-09T17:56:53.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66362024-09-09T17:56:53.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66372024-09-09T17:56:53.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66382024-09-09T17:56:53.501ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66392024-09-09T17:56:53.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66402024-09-09T17:56:53.504ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.843606ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
66412024-09-09T17:56:53.505ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66422024-09-09T17:56:53.505ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66432024-09-09T17:56:53.506ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.905727ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
66442024-09-09T17:56:53.508ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66452024-09-09T17:56:53.508ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66462024-09-09T17:56:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
66472024-09-09T17:56:53.508ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66482024-09-09T17:56:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66492024-09-09T17:56:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66502024-09-09T17:56:53.508ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 75.13425ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
66512024-09-09T17:56:53.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66522024-09-09T17:56:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66532024-09-09T17:56:53.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66542024-09-09T17:56:53.512ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66552024-09-09T17:56:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66562024-09-09T17:56:53.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
66572024-09-09T17:56:53.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66582024-09-09T17:56:53.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66592024-09-09T17:56:53.518ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66602024-09-09T17:56:53.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66612024-09-09T17:56:53.522ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66622024-09-09T17:56:53.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66632024-09-09T17:56:53.524ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66642024-09-09T17:56:53.525ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
66652024-09-09T17:56:53.525ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.695493ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
66662024-09-09T17:56:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
66672024-09-09T17:56:53.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66682024-09-09T17:56:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66692024-09-09T17:56:53.529ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 96.339544ms iteration = 10 status = 0
66702024-09-09T17:56:53.535ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
66712024-09-09T17:56:53.535ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66722024-09-09T17:56:53.535ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 102.093189ms iteration = 10 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
66732024-09-09T17:56:53.536ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.890663ms iteration = 10 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
66742024-09-09T17:56:53.536ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
66752024-09-09T17:56:53.536ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66762024-09-09T17:56:53.536ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ae840bb8-2a22-4e39-9264-1a79b2c1bf0b", "content-length": "26", "date": "Mon, 09 Sep 2024 17:56:53 GMT"} })
66772024-09-09T17:56:53.536ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66782024-09-09T17:56:53.538ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66792024-09-09T17:56:53.555ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 121.850754ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66802024-09-09T17:56:53.555ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f zone_address = fd00:1122:3344:101::2
66812024-09-09T17:56:53.555ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66822024-09-09T17:56:53.556ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cdb796af-164b-4198-94bd-cc59ca73d3ef", "content-length": "26", "date": "Mon, 09 Sep 2024 17:56:53 GMT"} })
66832024-09-09T17:56:53.556ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66842024-09-09T17:56:53.558ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
66852024-09-09T17:56:53.561ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66862024-09-09T17:56:53.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66872024-09-09T17:56:53.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 130.356244ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
66882024-09-09T17:56:53.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66892024-09-09T17:56:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66902024-09-09T17:56:53.587ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66912024-09-09T17:56:53.588ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 154.824657ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66922024-09-09T17:56:53.592ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 158.920281ms iteration = 12 status = {"physical_disks_added":0}
66932024-09-09T17:56:53.611ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
66942024-09-09T17:56:53.611ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66952024-09-09T17:56:53.611ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1f640d43-a2dd-4353-bd3b-3e20530f5942", "content-length": "26", "date": "Mon, 09 Sep 2024 17:56:53 GMT"} })
66962024-09-09T17:56:53.611ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66972024-09-09T17:56:53.614ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66982024-09-09T17:56:53.622ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66992024-09-09T17:56:53.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67002024-09-09T17:56:53.624ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67012024-09-09T17:56:53.626ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67022024-09-09T17:56:53.626ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67032024-09-09T17:56:53.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67042024-09-09T17:56:53.627ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67052024-09-09T17:56:53.629ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67062024-09-09T17:56:53.629ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67072024-09-09T17:56:53.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67082024-09-09T17:56:53.719ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67092024-09-09T17:56:53.719ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ba07ec1f-76e5-40bf-ab06-b9c483c06706", "content-length": "372", "date": "Mon, 09 Sep 2024 17:56:53 GMT"} })
67102024-09-09T17:56:53.719ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67112024-09-09T17:56:53.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67122024-09-09T17:56:53.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67132024-09-09T17:56:53.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67142024-09-09T17:56:53.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67152024-09-09T17:56:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67162024-09-09T17:56:53.729ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67172024-09-09T17:56:53.729ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5dc0b579-9a81-4b4f-b726-8722e172236a", "date": "Mon, 09 Sep 2024 17:56:53 GMT"} })
67182024-09-09T17:56:53.731ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 297.951305ms iteration = 11 status = {}
67192024-09-09T17:56:53.769ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67202024-09-09T17:56:53.771ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 338.354863ms iteration = 10 status = {}
67212024-09-09T17:56:53.796ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67222024-09-09T17:56:53.796ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fbf30eaf-157b-4a10-92b5-92c2c5bb9396", "content-length": "1", "date": "Mon, 09 Sep 2024 17:56:53 GMT"} })
67232024-09-09T17:56:53.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67242024-09-09T17:56:53.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67252024-09-09T17:56:53.804ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 371.524607ms iteration = 10 status = null
67262024-09-09T17:56:53.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67272024-09-09T17:56:53.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67282024-09-09T17:56:53.840ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 8ddbbc53-8b49-46f3-8c46-10ed4300f6d2, rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e) } rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
67292024-09-09T17:56:53.840ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67302024-09-09T17:56:53.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67312024-09-09T17:56:53.850ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
67322024-09-09T17:56:53.851ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8472c079-d0dc-42ce-bf13-bd26d3939261", "content-length": "121", "date": "Mon, 09 Sep 2024 17:56:53 GMT"} })
67332024-09-09T17:56:53.851ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
67342024-09-09T17:56:53.852ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e
67352024-09-09T17:56:53.852ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67362024-09-09T17:56:53.852ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67372024-09-09T17:56:53.852ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
67382024-09-09T17:56:53.852ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
67392024-09-09T17:56:53.852ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
67402024-09-09T17:56:53.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67412024-09-09T17:56:53.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67422024-09-09T17:56:53.854ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
67432024-09-09T17:56:53.855ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "41498b14-ccb9-4509-95c9-9d6428ecee36", "content-length": "2", "date": "Mon, 09 Sep 2024 17:56:53 GMT"} })
67442024-09-09T17:56:53.855ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
67452024-09-09T17:56:53.855ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d1e91c67-2dc0-4a7e-86ee-92c73528fd48", "content-length": "51", "date": "Mon, 09 Sep 2024 17:56:53 GMT"} })
67462024-09-09T17:56:53.855ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
67472024-09-09T17:56:53.855ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
67482024-09-09T17:56:53.887ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c815dfb9-82a1-4ded-8012-34265b53ba48", "content-length": "691", "date": "Mon, 09 Sep 2024 17:56:53 GMT"} })
67492024-09-09T17:56:53.887ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
67502024-09-09T17:56:53.887ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
67512024-09-09T17:56:53.887ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
67522024-09-09T17:56:53.888ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 455.421138ms iteration = 10 status = {}
67532024-09-09T17:56:53.977ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fd0d216f-fdb6-47b4-800c-ef7c7e5620f4", "date": "Mon, 09 Sep 2024 17:56:53 GMT"} })
67542024-09-09T17:56:53.977ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch = Switch0
67552024-09-09T17:56:53.977ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67562024-09-09T17:56:53.978ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ba50b199-f457-4252-89a4-eba43b8e2563", "content-length": "667", "date": "Mon, 09 Sep 2024 17:56:53 GMT"} })
67572024-09-09T17:56:53.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67582024-09-09T17:56:53.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67592024-09-09T17:56:53.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67602024-09-09T17:56:53.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67612024-09-09T17:56:53.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67622024-09-09T17:56:53.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67632024-09-09T17:56:53.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67642024-09-09T17:56:53.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67652024-09-09T17:56:53.995ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 562.513656ms iteration = 10 status = {}
67662024-09-09T17:56:55.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1160 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = bbe33c45-a102-429d-8f89-59729d047d94 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
67672024-09-09T17:57:03.432ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
67682024-09-09T17:57:03.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67692024-09-09T17:57:03.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67702024-09-09T17:57:03.433ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
67712024-09-09T17:57:03.433ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67722024-09-09T17:57:03.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67732024-09-09T17:57:03.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67742024-09-09T17:57:03.435ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67752024-09-09T17:57:03.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67762024-09-09T17:57:03.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67772024-09-09T17:57:03.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67782024-09-09T17:57:03.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67792024-09-09T17:57:03.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.077704ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67802024-09-09T17:57:03.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67812024-09-09T17:57:03.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67822024-09-09T17:57:03.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67832024-09-09T17:57:03.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
67842024-09-09T17:57:03.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67852024-09-09T17:57:03.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67862024-09-09T17:57:03.450ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
67872024-09-09T17:57:03.451ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.226357ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
67882024-09-09T17:57:05.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1284 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = d76b2fd9-5482-4e56-8e29-31228ecf2ae3 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
67892024-09-09T17:57:13.433ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
67902024-09-09T17:57:13.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67912024-09-09T17:57:13.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67922024-09-09T17:57:13.433ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
67932024-09-09T17:57:13.433ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67942024-09-09T17:57:13.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67952024-09-09T17:57:13.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67962024-09-09T17:57:13.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67972024-09-09T17:57:13.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67982024-09-09T17:57:13.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67992024-09-09T17:57:13.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68002024-09-09T17:57:13.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.962733ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68012024-09-09T17:57:13.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68022024-09-09T17:57:13.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68032024-09-09T17:57:13.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68042024-09-09T17:57:13.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68052024-09-09T17:57:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
68062024-09-09T17:57:13.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68072024-09-09T17:57:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68082024-09-09T17:57:13.452ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
68092024-09-09T17:57:13.452ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.934581ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
68102024-09-09T17:57:15.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1211 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = b4a9ed79-803b-4aa2-ab85-12f092d75d47 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
68112024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
68122024-09-09T17:57:23.433ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b
68132024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.671\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b"}
68142024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
68152024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
68162024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
68172024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
68182024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68192024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
68202024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
68212024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
68222024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68232024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
68242024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
68252024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68262024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68272024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
68282024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
68292024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
68302024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
68312024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68322024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
68332024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
68342024-09-09T17:57:23.433ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-09 17:47:23.433332264 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
68352024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
68362024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
68372024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68382024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68392024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68402024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
68412024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68422024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68432024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
68442024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
68452024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
68462024-09-09T17:57:23.433ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
68472024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
68482024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
68492024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68502024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
68512024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68522024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
68532024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68542024-09-09T17:57:23.433ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
68552024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68562024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
68572024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68582024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
68592024-09-09T17:57:23.434ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
68602024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
68612024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
68622024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
68632024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
68642024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
68652024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
68662024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68672024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
68682024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
68692024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68702024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
68712024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68722024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
68732024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68742024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
68752024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68762024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
68772024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68782024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
68792024-09-09T17:57:23.434ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
68802024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68812024-09-09T17:57:23.434ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("21f5073c-362d-497d-ae9e-f6ab85374703.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("42b0964a-b1a3-443e-b006-c18e1ad8d003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 33965, tv_nsec: 35577778 } })
68822024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
68832024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68842024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68852024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68862024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
68872024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68882024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68892024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68902024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
68912024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68922024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68932024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68942024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
68952024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
68962024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68972024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68982024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68992024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69002024-09-09T17:57:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69012024-09-09T17:57:23.435ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("07c1bbdd-f080-4837-9528-41234be47bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 33965, tv_nsec: 36644654 } })
69022024-09-09T17:57:23.436ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
69032024-09-09T17:57:23.436ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.202909ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
69042024-09-09T17:57:23.436ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.653401ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
69052024-09-09T17:57:23.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69062024-09-09T17:57:23.437ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69072024-09-09T17:57:23.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69082024-09-09T17:57:23.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69092024-09-09T17:57:23.438ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-09 17:47:23.433332264 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
69102024-09-09T17:57:23.438ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.286431ms iteration = 6 status = {"expiration":"2024-09-09T17:47:23.433332264Z","pruned":[]}
69112024-09-09T17:57:23.439ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69122024-09-09T17:57:23.439ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69132024-09-09T17:57:23.440ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33965, tv_nsec: 41609894 } })
69142024-09-09T17:57:23.440ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
69152024-09-09T17:57:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69162024-09-09T17:57:23.440ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 6.916891ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
69172024-09-09T17:57:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69182024-09-09T17:57:23.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69192024-09-09T17:57:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69202024-09-09T17:57:23.442ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69212024-09-09T17:57:23.442ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33965, tv_nsec: 44398300 } })
69222024-09-09T17:57:23.443ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
69232024-09-09T17:57:23.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69242024-09-09T17:57:23.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69252024-09-09T17:57:23.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69262024-09-09T17:57:23.444ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
69272024-09-09T17:57:23.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69282024-09-09T17:57:23.445ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69292024-09-09T17:57:23.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
69302024-09-09T17:57:23.447ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
69312024-09-09T17:57:23.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69322024-09-09T17:57:23.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69332024-09-09T17:57:23.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69342024-09-09T17:57:23.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69352024-09-09T17:57:23.452ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69362024-09-09T17:57:23.453ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.163952ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
69372024-09-09T17:57:23.455ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69382024-09-09T17:57:23.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
69392024-09-09T17:57:23.455ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69402024-09-09T17:57:23.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69412024-09-09T17:57:23.456ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69422024-09-09T17:57:23.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69432024-09-09T17:57:23.457ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69442024-09-09T17:57:23.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69452024-09-09T17:57:23.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69462024-09-09T17:57:23.458ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69472024-09-09T17:57:23.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69482024-09-09T17:57:23.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69492024-09-09T17:57:23.463ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69502024-09-09T17:57:23.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69512024-09-09T17:57:23.464ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
69522024-09-09T17:57:23.464ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
69532024-09-09T17:57:23.464ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
69542024-09-09T17:57:23.464ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69552024-09-09T17:57:23.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69562024-09-09T17:57:23.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69572024-09-09T17:57:23.466ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69582024-09-09T17:57:23.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69592024-09-09T17:57:23.472ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69602024-09-09T17:57:23.475ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69612024-09-09T17:57:23.475ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69622024-09-09T17:57:23.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69632024-09-09T17:57:23.478ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69642024-09-09T17:57:23.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69652024-09-09T17:57:23.478ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69662024-09-09T17:57:23.478ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69672024-09-09T17:57:23.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69682024-09-09T17:57:23.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69692024-09-09T17:57:23.489ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69702024-09-09T17:57:23.489ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
69712024-09-09T17:57:23.489ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 55.833507ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
69722024-09-09T17:57:23.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
69732024-09-09T17:57:23.494ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69742024-09-09T17:57:23.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69752024-09-09T17:57:23.500ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69762024-09-09T17:57:23.500ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
69772024-09-09T17:57:23.500ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
69782024-09-09T17:57:23.500ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69792024-09-09T17:57:23.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69802024-09-09T17:57:23.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69812024-09-09T17:57:23.502ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69822024-09-09T17:57:23.503ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69832024-09-09T17:57:23.503ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69842024-09-09T17:57:23.503ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.85781ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
69852024-09-09T17:57:23.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69862024-09-09T17:57:23.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69872024-09-09T17:57:23.504ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
69882024-09-09T17:57:23.504ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
69892024-09-09T17:57:23.504ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 70.345982ms iteration = 6 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
69902024-09-09T17:57:23.505ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69912024-09-09T17:57:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
69922024-09-09T17:57:23.506ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69932024-09-09T17:57:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69942024-09-09T17:57:23.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69952024-09-09T17:57:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69962024-09-09T17:57:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69972024-09-09T17:57:23.508ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69982024-09-09T17:57:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69992024-09-09T17:57:23.509ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
70002024-09-09T17:57:23.509ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
70012024-09-09T17:57:23.509ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 75.357131ms iteration = 11 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
70022024-09-09T17:57:23.511ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 77.963666ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
70032024-09-09T17:57:23.512ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33965, tv_nsec: 114188219 } })
70042024-09-09T17:57:23.513ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
70052024-09-09T17:57:23.517ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70062024-09-09T17:57:23.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70072024-09-09T17:57:23.520ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.408276ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
70082024-09-09T17:57:23.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70092024-09-09T17:57:23.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70102024-09-09T17:57:23.530ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70112024-09-09T17:57:23.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70122024-09-09T17:57:23.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70132024-09-09T17:57:23.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70142024-09-09T17:57:23.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
70152024-09-09T17:57:23.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70162024-09-09T17:57:23.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70172024-09-09T17:57:23.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
70182024-09-09T17:57:23.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70192024-09-09T17:57:23.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70202024-09-09T17:57:23.538ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
70212024-09-09T17:57:23.538ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
70222024-09-09T17:57:23.538ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 104.856984ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
70232024-09-09T17:57:23.539ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 106.103841ms iteration = 11 status = 0
70242024-09-09T17:57:23.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70252024-09-09T17:57:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70262024-09-09T17:57:23.545ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70272024-09-09T17:57:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70282024-09-09T17:57:23.547ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 113.361005ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70292024-09-09T17:57:23.552ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70302024-09-09T17:57:23.552ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
70312024-09-09T17:57:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70322024-09-09T17:57:23.552ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
70332024-09-09T17:57:23.552ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
70342024-09-09T17:57:23.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70352024-09-09T17:57:23.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70362024-09-09T17:57:23.554ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.340805ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
70372024-09-09T17:57:23.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70382024-09-09T17:57:23.555ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70392024-09-09T17:57:23.555ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
70402024-09-09T17:57:23.555ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 122.695129ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
70412024-09-09T17:57:23.557ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
70422024-09-09T17:57:23.557ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70432024-09-09T17:57:23.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70442024-09-09T17:57:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70452024-09-09T17:57:23.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70462024-09-09T17:57:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70472024-09-09T17:57:23.563ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
70482024-09-09T17:57:23.563ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 0 version = 2
70492024-09-09T17:57:23.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70502024-09-09T17:57:23.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70512024-09-09T17:57:23.565ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70522024-09-09T17:57:23.566ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70532024-09-09T17:57:23.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70542024-09-09T17:57:23.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70552024-09-09T17:57:23.568ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70562024-09-09T17:57:23.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70572024-09-09T17:57:23.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70582024-09-09T17:57:23.569ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70592024-09-09T17:57:23.570ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 1 version = 2
70602024-09-09T17:57:23.570ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
70612024-09-09T17:57:23.570ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-09 17:52:54.528560 UTC dns_group = external generation = 2
70622024-09-09T17:57:23.570ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 137.021423ms iteration = 7 status = {"generation":2}
70632024-09-09T17:57:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70642024-09-09T17:57:23.571ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70652024-09-09T17:57:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70662024-09-09T17:57:23.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
70672024-09-09T17:57:23.573ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70682024-09-09T17:57:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70692024-09-09T17:57:23.578ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70702024-09-09T17:57:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70712024-09-09T17:57:23.580ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70722024-09-09T17:57:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70732024-09-09T17:57:23.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 148.117167ms iteration = 11 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
70742024-09-09T17:57:23.582ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70752024-09-09T17:57:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
70762024-09-09T17:57:23.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70772024-09-09T17:57:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70782024-09-09T17:57:23.588ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70792024-09-09T17:57:23.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70802024-09-09T17:57:23.604ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
70812024-09-09T17:57:23.605ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
70822024-09-09T17:57:23.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70832024-09-09T17:57:23.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70842024-09-09T17:57:23.606ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-09T17:52:21.456201Z, time_modified: 2024-09-09T17:52:21.456201Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }) }
70852024-09-09T17:57:23.606ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 172.957213ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]}},"default_endpoint":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
70862024-09-09T17:57:23.612ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70872024-09-09T17:57:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70882024-09-09T17:57:23.659ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
70892024-09-09T17:57:23.659ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70902024-09-09T17:57:23.660ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "78396622-993b-4666-88cc-6d2c232369fb", "content-length": "26", "date": "Mon, 09 Sep 2024 17:57:23 GMT"} })
70912024-09-09T17:57:23.660ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70922024-09-09T17:57:23.662ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70932024-09-09T17:57:23.665ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 232.007899ms iteration = 13 status = {"physical_disks_added":0}
70942024-09-09T17:57:23.673ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f zone_address = fd00:1122:3344:101::2
70952024-09-09T17:57:23.673ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70962024-09-09T17:57:23.674ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2ab95cfe-6f0f-4665-bcd9-20abf97e496d", "content-length": "26", "date": "Mon, 09 Sep 2024 17:57:23 GMT"} })
70972024-09-09T17:57:23.674ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70982024-09-09T17:57:23.675ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
70992024-09-09T17:57:23.688ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
71002024-09-09T17:57:23.719ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
71012024-09-09T17:57:23.719ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71022024-09-09T17:57:23.719ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bc55f34c-ffa7-45b9-9bd4-ad3ecbd4207a", "content-length": "26", "date": "Mon, 09 Sep 2024 17:57:23 GMT"} })
71032024-09-09T17:57:23.719ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71042024-09-09T17:57:23.721ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71052024-09-09T17:57:23.735ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
71062024-09-09T17:57:23.757ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71072024-09-09T17:57:23.758ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "64e48ebd-2db9-47eb-87e6-4fcf89c56be4", "content-length": "372", "date": "Mon, 09 Sep 2024 17:57:23 GMT"} })
71082024-09-09T17:57:23.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71092024-09-09T17:57:23.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71102024-09-09T17:57:23.760ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71112024-09-09T17:57:23.760ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71122024-09-09T17:57:23.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71132024-09-09T17:57:23.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71142024-09-09T17:57:23.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71152024-09-09T17:57:23.763ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71162024-09-09T17:57:23.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71172024-09-09T17:57:23.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71182024-09-09T17:57:23.765ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71192024-09-09T17:57:23.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71202024-09-09T17:57:23.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71212024-09-09T17:57:23.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71222024-09-09T17:57:23.767ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71232024-09-09T17:57:23.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71242024-09-09T17:57:23.767ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71252024-09-09T17:57:23.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71262024-09-09T17:57:23.768ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
71272024-09-09T17:57:23.768ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
71282024-09-09T17:57:23.768ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71292024-09-09T17:57:23.768ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-09 17:52:53.875764 UTC dns_group = internal generation = 1
71302024-09-09T17:57:23.768ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 335.607856ms iteration = 7 status = {"generation":1}
71312024-09-09T17:57:23.769ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71322024-09-09T17:57:23.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71332024-09-09T17:57:23.769ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71342024-09-09T17:57:23.770ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9eef1d7c-4164-4c96-a192-747a09f60728", "date": "Mon, 09 Sep 2024 17:57:23 GMT"} })
71352024-09-09T17:57:23.770ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71362024-09-09T17:57:23.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71372024-09-09T17:57:23.771ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 337.98803ms iteration = 12 status = {}
71382024-09-09T17:57:23.772ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71392024-09-09T17:57:23.773ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71402024-09-09T17:57:23.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71412024-09-09T17:57:23.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71422024-09-09T17:57:23.775ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71432024-09-09T17:57:23.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
71442024-09-09T17:57:23.776ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71452024-09-09T17:57:23.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71462024-09-09T17:57:23.777ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71472024-09-09T17:57:23.777ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71482024-09-09T17:57:23.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71492024-09-09T17:57:23.778ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71502024-09-09T17:57:23.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71512024-09-09T17:57:23.782ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71522024-09-09T17:57:23.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71532024-09-09T17:57:23.785ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71542024-09-09T17:57:23.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71552024-09-09T17:57:23.787ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71562024-09-09T17:57:23.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71572024-09-09T17:57:23.789ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71582024-09-09T17:57:23.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71592024-09-09T17:57:23.850ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
71602024-09-09T17:57:23.852ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "76e4fe4a-19a4-488c-bd6c-a243c4506b16", "content-length": "1", "date": "Mon, 09 Sep 2024 17:57:23 GMT"} })
71612024-09-09T17:57:23.853ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71622024-09-09T17:57:23.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71632024-09-09T17:57:23.981ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
71642024-09-09T17:57:23.982ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "dc88c0d5-0007-4769-9bb2-401713420967", "date": "Mon, 09 Sep 2024 17:57:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71652024-09-09T17:57:23.982ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71662024-09-09T17:57:23.984ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "20a0fd9f-e4d5-4eef-a90b-976d5382516d", "date": "Mon, 09 Sep 2024 17:57:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71672024-09-09T17:57:23.984ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71682024-09-09T17:57:23.986ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71692024-09-09T17:57:23.986ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 552.97288ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
71702024-09-09T17:57:24.030ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
71712024-09-09T17:57:24.032ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71722024-09-09T17:57:24.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71732024-09-09T17:57:24.032ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
71742024-09-09T17:57:24.033ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 599.826414ms iteration = 11 status = null
71752024-09-09T17:57:24.034ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71762024-09-09T17:57:24.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
71772024-09-09T17:57:24.037ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71782024-09-09T17:57:24.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71792024-09-09T17:57:24.039ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71802024-09-09T17:57:24.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71812024-09-09T17:57:24.041ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71822024-09-09T17:57:24.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71832024-09-09T17:57:24.043ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71842024-09-09T17:57:24.046ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
71852024-09-09T17:57:24.046ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71862024-09-09T17:57:24.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71872024-09-09T17:57:24.049ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 616.360552ms iteration = 11 status = {}
71882024-09-09T17:57:24.051ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71892024-09-09T17:57:24.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71902024-09-09T17:57:24.053ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71912024-09-09T17:57:24.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71922024-09-09T17:57:24.056ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71932024-09-09T17:57:24.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71942024-09-09T17:57:24.058ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71952024-09-09T17:57:24.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71962024-09-09T17:57:24.061ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71972024-09-09T17:57:24.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71982024-09-09T17:57:24.062ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71992024-09-09T17:57:24.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72002024-09-09T17:57:24.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72012024-09-09T17:57:24.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72022024-09-09T17:57:24.064ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72032024-09-09T17:57:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72042024-09-09T17:57:24.065ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "921b6064-a515-4183-96c4-c32a65799fbc", "content-length": "691", "date": "Mon, 09 Sep 2024 17:57:24 GMT"} })
72052024-09-09T17:57:24.065ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
72062024-09-09T17:57:24.065ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
72072024-09-09T17:57:24.065ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
72082024-09-09T17:57:24.066ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72092024-09-09T17:57:24.066ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 8ddbbc53-8b49-46f3-8c46-10ed4300f6d2, rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e) } rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
72102024-09-09T17:57:24.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72112024-09-09T17:57:24.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72122024-09-09T17:57:24.067ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 633.470122ms iteration = 11 status = {}
72132024-09-09T17:57:24.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
72142024-09-09T17:57:24.069ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72152024-09-09T17:57:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72162024-09-09T17:57:24.070ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72172024-09-09T17:57:24.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72182024-09-09T17:57:24.072ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72192024-09-09T17:57:24.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72202024-09-09T17:57:24.074ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72212024-09-09T17:57:24.077ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
72222024-09-09T17:57:24.077ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72232024-09-09T17:57:24.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72242024-09-09T17:57:24.077ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72252024-09-09T17:57:24.078ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e6ead37e-9174-408a-844f-b81ee3db4af3", "content-length": "121", "date": "Mon, 09 Sep 2024 17:57:23 GMT"} })
72262024-09-09T17:57:24.078ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
72272024-09-09T17:57:24.078ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e
72282024-09-09T17:57:24.078ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72292024-09-09T17:57:24.078ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72302024-09-09T17:57:24.078ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
72312024-09-09T17:57:24.078ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
72322024-09-09T17:57:24.078ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
72332024-09-09T17:57:24.078ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72342024-09-09T17:57:24.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72352024-09-09T17:57:24.080ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72362024-09-09T17:57:24.081ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1203d2e8-8678-4242-ab5d-0086d255a219", "content-length": "2", "date": "Mon, 09 Sep 2024 17:57:23 GMT"} })
72372024-09-09T17:57:24.081ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72382024-09-09T17:57:24.081ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "77a2fae4-caeb-4072-9a15-a3468401a798", "content-length": "51", "date": "Mon, 09 Sep 2024 17:57:23 GMT"} })
72392024-09-09T17:57:24.081ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
72402024-09-09T17:57:24.081ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72412024-09-09T17:57:24.084ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 2b31f448-70f4-4ab8-9cd0-36ff4c28255b, kind: Service { id: ca022d43-3da4-4507-941c-6fd9da5b668d }, name: Name("nexus-ca022d43-3da4-4507-941c-6fd9da5b668d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 49852929-112c-4ccc-bc3e-c924ce561472, kind: Service { id: fd75f244-5e91-4f63-b3b2-ae4139e91823 }, name: Name("nexus-fd75f244-5e91-4f63-b3b2-ae4139e91823"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 64])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f29fffc4-b4e4-4069-af7f-4a0100b36168, kind: Service { id: 4c6ef9f1-4001-4c65-ae99-bafe915b66f8 }, name: Name("nexus-4c6ef9f1-4001-4c65-ae99-bafe915b66f8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 44])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 5db99faa-847d-4c67-baad-c7351bdbf8f8, kind: Service { id: 07c1bbdd-f080-4837-9528-41234be47bda }, name: Name("external-dns-07c1bbdd-f080-4837-9528-41234be47bda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ffc9837e-602d-49be-aea3-1a5919d80850, kind: Service { id: 9711344c-11c4-490b-9560-e9c007eb0cf3 }, name: Name("external-dns-9711344c-11c4-490b-9560-e9c007eb0cf3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
72422024-09-09T17:57:24.084ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72432024-09-09T17:57:24.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72442024-09-09T17:57:24.085ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
72452024-09-09T17:57:24.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72462024-09-09T17:57:24.086ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "02c98ed5-4cc5-4095-992e-dacc35f01dc6", "date": "Mon, 09 Sep 2024 17:57:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
72472024-09-09T17:57:24.086ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
72482024-09-09T17:57:24.087ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
72492024-09-09T17:57:24.087ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72502024-09-09T17:57:24.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72512024-09-09T17:57:24.087ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "00adb1e5-add1-4ed5-8986-24edd1eff1fb", "date": "Mon, 09 Sep 2024 17:57:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
72522024-09-09T17:57:24.087ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
72532024-09-09T17:57:24.089ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "09187129-58f5-424e-bc67-de6b37262a75", "date": "Mon, 09 Sep 2024 17:57:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
72542024-09-09T17:57:24.089ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
72552024-09-09T17:57:24.091ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
72562024-09-09T17:57:24.091ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 658.466728ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
72572024-09-09T17:57:24.092ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
72582024-09-09T17:57:24.092ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5db99faa-847d-4c67-baad-c7351bdbf8f8, kind: Service { id: 07c1bbdd-f080-4837-9528-41234be47bda }, name: Name("external-dns-07c1bbdd-f080-4837-9528-41234be47bda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ffc9837e-602d-49be-aea3-1a5919d80850, kind: Service { id: 9711344c-11c4-490b-9560-e9c007eb0cf3 }, name: Name("external-dns-9711344c-11c4-490b-9560-e9c007eb0cf3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2b31f448-70f4-4ab8-9cd0-36ff4c28255b, kind: Service { id: ca022d43-3da4-4507-941c-6fd9da5b668d }, name: Name("nexus-ca022d43-3da4-4507-941c-6fd9da5b668d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 49852929-112c-4ccc-bc3e-c924ce561472, kind: Service { id: fd75f244-5e91-4f63-b3b2-ae4139e91823 }, name: Name("nexus-fd75f244-5e91-4f63-b3b2-ae4139e91823"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 64])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f29fffc4-b4e4-4069-af7f-4a0100b36168, kind: Service { id: 4c6ef9f1-4001-4c65-ae99-bafe915b66f8 }, name: Name("nexus-4c6ef9f1-4001-4c65-ae99-bafe915b66f8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 44])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
72592024-09-09T17:57:24.092ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
72602024-09-09T17:57:24.155ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, time_created: 2024-09-09T17:52:49.417856Z, time_modified: 2024-09-09T17:52:49.417856Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
72612024-09-09T17:57:24.155ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
72622024-09-09T17:57:24.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72632024-09-09T17:57:24.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72642024-09-09T17:57:24.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72652024-09-09T17:57:24.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72662024-09-09T17:57:24.159ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72672024-09-09T17:57:24.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
72682024-09-09T17:57:24.184ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "94cee6fb-438b-43b6-9eb9-a1ba91eb00d7", "date": "Mon, 09 Sep 2024 17:57:23 GMT"} })
72692024-09-09T17:57:24.184ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch = Switch0
72702024-09-09T17:57:24.184ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72712024-09-09T17:57:24.185ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "19c496dd-a30d-4cb6-81ad-3d6b62add3a0", "content-length": "667", "date": "Mon, 09 Sep 2024 17:57:24 GMT"} })
72722024-09-09T17:57:24.185ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72732024-09-09T17:57:24.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72742024-09-09T17:57:24.188ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72752024-09-09T17:57:24.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72762024-09-09T17:57:24.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72772024-09-09T17:57:24.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72782024-09-09T17:57:24.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72792024-09-09T17:57:24.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72802024-09-09T17:57:24.195ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
72812024-09-09T17:57:24.197ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "33978667-75f1-419f-92d4-6a13e7cd32a7", "date": "Mon, 09 Sep 2024 17:57:24 GMT"} })
72822024-09-09T17:57:24.198ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
72832024-09-09T17:57:24.198ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 764.859281ms
72842024-09-09T17:57:24.198ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 764.867352ms iteration = 2 status = {}
72852024-09-09T17:57:24.202ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 768.413813ms iteration = 11 status = {}
72862024-09-09T17:57:25.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1349 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = d7de8fb4-2ed9-452e-a7e5-e0338a26272b response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
72872024-09-09T17:57:27.169ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:48413
72882024-09-09T17:57:27.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48413 req_id = 0b23a2cd-bfd9-42c0-a7c8-9ceca8733349 roles = RoleSet { roles: {} } uri = /metrics/producers
72892024-09-09T17:57:27.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48413 req_id = 0b23a2cd-bfd9-42c0-a7c8-9ceca8733349 resource = Database result = Ok(()) uri = /metrics/producers
72902024-09-09T17:57:27.202ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
72912024-09-09T17:57:27.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48413 req_id = 0b23a2cd-bfd9-42c0-a7c8-9ceca8733349 roles = RoleSet { roles: {} } uri = /metrics/producers
72922024-09-09T17:57:27.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48413 req_id = 0b23a2cd-bfd9-42c0-a7c8-9ceca8733349 resource = Database result = Ok(()) uri = /metrics/producers
72932024-09-09T17:57:27.234ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
72942024-09-09T17:57:27.234ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "47ce2e9e-f2d6-40bc-ba05-6c353f646bea", "date": "Mon, 09 Sep 2024 17:57:27 GMT"} })
72952024-09-09T17:57:27.234ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 11e4ca7f-2a45-4733-9ef1-4614c608a84b
72962024-09-09T17:57:27.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 66367 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48413 req_id = 0b23a2cd-bfd9-42c0-a7c8-9ceca8733349 response_code = 201 uri = /metrics/producers
72972024-09-09T17:57:30.329ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:38449
72982024-09-09T17:57:30.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38449 req_id = 01a26b3f-5068-44ae-a56b-08eacff2f8af roles = RoleSet { roles: {} } uri = /metrics/producers
72992024-09-09T17:57:30.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38449 req_id = 01a26b3f-5068-44ae-a56b-08eacff2f8af resource = Database result = Ok(()) uri = /metrics/producers
73002024-09-09T17:57:30.381ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
73012024-09-09T17:57:30.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38449 req_id = 01a26b3f-5068-44ae-a56b-08eacff2f8af roles = RoleSet { roles: {} } uri = /metrics/producers
73022024-09-09T17:57:30.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38449 req_id = 01a26b3f-5068-44ae-a56b-08eacff2f8af resource = Database result = Ok(()) uri = /metrics/producers
73032024-09-09T17:57:30.423ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
73042024-09-09T17:57:30.423ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2983ab72-05f8-4c16-98e4-5d17966b0aef", "date": "Mon, 09 Sep 2024 17:57:30 GMT"} })
73052024-09-09T17:57:30.423ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = fdca555f-3b9a-4118-ba07-7428edbb0dfc
73062024-09-09T17:57:30.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95282 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38449 req_id = 01a26b3f-5068-44ae-a56b-08eacff2f8af response_code = 201 uri = /metrics/producers
73072024-09-09T17:57:31.924ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:49033
73082024-09-09T17:57:31.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49033 req_id = 070af013-ade4-4acb-98ab-737fa4b9b5af roles = RoleSet { roles: {} } uri = /metrics/producers
73092024-09-09T17:57:31.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49033 req_id = 070af013-ade4-4acb-98ab-737fa4b9b5af resource = Database result = Ok(()) uri = /metrics/producers
73102024-09-09T17:57:31.958ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
73112024-09-09T17:57:31.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49033 req_id = 070af013-ade4-4acb-98ab-737fa4b9b5af roles = RoleSet { roles: {} } uri = /metrics/producers
73122024-09-09T17:57:31.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49033 req_id = 070af013-ade4-4acb-98ab-737fa4b9b5af resource = Database result = Ok(()) uri = /metrics/producers
73132024-09-09T17:57:31.988ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
73142024-09-09T17:57:31.988ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6cd3d0d8-e05c-4d34-9c62-a3a273f1f33b", "date": "Mon, 09 Sep 2024 17:57:31 GMT"} })
73152024-09-09T17:57:31.988ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60
73162024-09-09T17:57:31.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 65269 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49033 req_id = 070af013-ade4-4acb-98ab-737fa4b9b5af response_code = 201 uri = /metrics/producers
73172024-09-09T17:57:33.433ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
73182024-09-09T17:57:33.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73192024-09-09T17:57:33.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73202024-09-09T17:57:33.433ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
73212024-09-09T17:57:33.433ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73222024-09-09T17:57:33.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73232024-09-09T17:57:33.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73242024-09-09T17:57:33.435ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73252024-09-09T17:57:33.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73262024-09-09T17:57:33.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73272024-09-09T17:57:33.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73282024-09-09T17:57:33.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.626411ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73292024-09-09T17:57:33.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73302024-09-09T17:57:33.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73312024-09-09T17:57:33.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73322024-09-09T17:57:33.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73332024-09-09T17:57:33.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
73342024-09-09T17:57:33.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73352024-09-09T17:57:33.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73362024-09-09T17:57:33.454ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
73372024-09-09T17:57:33.454ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.351565ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
73382024-09-09T17:57:35.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1120 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 66df8754-2da2-40f3-b358-eac772f69176 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
73392024-09-09T17:57:37.987ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:38474
73402024-09-09T17:57:37.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38474 req_id = 466d4f91-aa8c-4558-96b3-099a1e250bb2 roles = RoleSet { roles: {} } uri = /metrics/producers
73412024-09-09T17:57:37.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38474 req_id = 466d4f91-aa8c-4558-96b3-099a1e250bb2 resource = Database result = Ok(()) uri = /metrics/producers
73422024-09-09T17:57:38.019ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
73432024-09-09T17:57:38.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38474 req_id = 466d4f91-aa8c-4558-96b3-099a1e250bb2 roles = RoleSet { roles: {} } uri = /metrics/producers
73442024-09-09T17:57:38.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38474 req_id = 466d4f91-aa8c-4558-96b3-099a1e250bb2 resource = Database result = Ok(()) uri = /metrics/producers
73452024-09-09T17:57:38.029ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
73462024-09-09T17:57:38.029ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f1c59906-2f2f-420e-9852-8b8aa068f0ba", "date": "Mon, 09 Sep 2024 17:57:38 GMT"} })
73472024-09-09T17:57:38.029ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = fd6a3800-ebfc-41fd-a922-894d8d51ff21
73482024-09-09T17:57:38.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 44413 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38474 req_id = 466d4f91-aa8c-4558-96b3-099a1e250bb2 response_code = 201 uri = /metrics/producers
73492024-09-09T17:57:43.434ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
73502024-09-09T17:57:43.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73512024-09-09T17:57:43.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73522024-09-09T17:57:43.434ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
73532024-09-09T17:57:43.434ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73542024-09-09T17:57:43.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73552024-09-09T17:57:43.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73562024-09-09T17:57:43.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73572024-09-09T17:57:43.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73582024-09-09T17:57:43.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.959613ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73592024-09-09T17:57:43.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73602024-09-09T17:57:43.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73612024-09-09T17:57:43.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73622024-09-09T17:57:43.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73632024-09-09T17:57:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73642024-09-09T17:57:43.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73652024-09-09T17:57:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
73662024-09-09T17:57:43.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73672024-09-09T17:57:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73682024-09-09T17:57:43.450ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
73692024-09-09T17:57:43.450ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.344706ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
73702024-09-09T17:57:45.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1195 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 65257533-5be1-4d35-a4d2-f9dae08f9eee response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
73712024-09-09T17:57:53.434ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
73722024-09-09T17:57:53.434ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
73732024-09-09T17:57:53.434ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73742024-09-09T17:57:53.434ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
73752024-09-09T17:57:53.434ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
73762024-09-09T17:57:53.434ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
73772024-09-09T17:57:53.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73782024-09-09T17:57:53.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73792024-09-09T17:57:53.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73802024-09-09T17:57:53.434ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
73812024-09-09T17:57:53.434ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
73822024-09-09T17:57:53.434ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
73832024-09-09T17:57:53.434ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
73842024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73852024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73862024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
73872024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73882024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
73892024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
73902024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
73912024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73922024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
73932024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
73942024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
73952024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73962024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
73972024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73982024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73992024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
74002024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74012024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
74022024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74032024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
74042024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
74052024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
74062024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74072024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74082024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
74092024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74102024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74112024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74122024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74132024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74142024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74152024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74162024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
74172024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74182024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74192024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74202024-09-09T17:57:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74212024-09-09T17:57:53.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74222024-09-09T17:57:53.437ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.46306ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
74232024-09-09T17:57:53.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.217609ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
74242024-09-09T17:57:53.438ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33995, tv_nsec: 38880481 } })
74252024-09-09T17:57:53.438ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
74262024-09-09T17:57:53.439ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33995, tv_nsec: 40212888 } })
74272024-09-09T17:57:53.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74282024-09-09T17:57:53.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74292024-09-09T17:57:53.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74302024-09-09T17:57:53.440ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
74312024-09-09T17:57:53.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74322024-09-09T17:57:53.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
74332024-09-09T17:57:53.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74342024-09-09T17:57:53.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74352024-09-09T17:57:53.449ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.101102ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
74362024-09-09T17:57:53.449ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74372024-09-09T17:57:53.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74382024-09-09T17:57:53.453ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74392024-09-09T17:57:53.455ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74402024-09-09T17:57:53.455ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74412024-09-09T17:57:53.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74422024-09-09T17:57:53.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74432024-09-09T17:57:53.456ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74442024-09-09T17:57:53.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74452024-09-09T17:57:53.456ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74462024-09-09T17:57:53.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74472024-09-09T17:57:53.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74482024-09-09T17:57:53.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74492024-09-09T17:57:53.459ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74502024-09-09T17:57:53.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74512024-09-09T17:57:53.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74522024-09-09T17:57:53.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
74532024-09-09T17:57:53.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74542024-09-09T17:57:53.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74552024-09-09T17:57:53.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
74562024-09-09T17:57:53.460ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74572024-09-09T17:57:53.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74582024-09-09T17:57:53.463ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 27.984614ms iteration = 12 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
74592024-09-09T17:57:53.463ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74602024-09-09T17:57:53.463ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74612024-09-09T17:57:53.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74622024-09-09T17:57:53.463ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74632024-09-09T17:57:53.465ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74642024-09-09T17:57:53.468ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74652024-09-09T17:57:53.468ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74662024-09-09T17:57:53.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74672024-09-09T17:57:53.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
74682024-09-09T17:57:53.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74692024-09-09T17:57:53.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74702024-09-09T17:57:53.468ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74712024-09-09T17:57:53.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74722024-09-09T17:57:53.468ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74732024-09-09T17:57:53.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74742024-09-09T17:57:53.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74752024-09-09T17:57:53.470ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33995, tv_nsec: 70937549 } })
74762024-09-09T17:57:53.470ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
74772024-09-09T17:57:53.478ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
74782024-09-09T17:57:53.478ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.077009ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
74792024-09-09T17:57:53.484ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74802024-09-09T17:57:53.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74812024-09-09T17:57:53.486ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 51.921914ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
74822024-09-09T17:57:53.488ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
74832024-09-09T17:57:53.488ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
74842024-09-09T17:57:53.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74852024-09-09T17:57:53.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74862024-09-09T17:57:53.494ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74872024-09-09T17:57:53.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74882024-09-09T17:57:53.497ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74892024-09-09T17:57:53.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74902024-09-09T17:57:53.500ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.648445ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74912024-09-09T17:57:53.503ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74922024-09-09T17:57:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74932024-09-09T17:57:53.505ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 70.624584ms iteration = 14 status = {"physical_disks_added":0}
74942024-09-09T17:57:53.528ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
74952024-09-09T17:57:53.528ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 93.292607ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
74962024-09-09T17:57:53.555ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
74972024-09-09T17:57:53.555ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74982024-09-09T17:57:53.555ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5d8d7e28-0d3d-4166-9b0e-8102436bf156", "content-length": "26", "date": "Mon, 09 Sep 2024 17:57:53 GMT"} })
74992024-09-09T17:57:53.555ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75002024-09-09T17:57:53.557ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75012024-09-09T17:57:53.603ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75022024-09-09T17:57:53.604ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "75426916-0081-40cb-9ddc-3d58bcf16bc4", "content-length": "372", "date": "Mon, 09 Sep 2024 17:57:53 GMT"} })
75032024-09-09T17:57:53.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75042024-09-09T17:57:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75052024-09-09T17:57:53.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75062024-09-09T17:57:53.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75072024-09-09T17:57:53.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75082024-09-09T17:57:53.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75092024-09-09T17:57:53.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75102024-09-09T17:57:53.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75112024-09-09T17:57:53.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75122024-09-09T17:57:53.615ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75132024-09-09T17:57:53.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
75142024-09-09T17:57:53.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75152024-09-09T17:57:53.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75162024-09-09T17:57:53.615ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e2dc21dc-19e4-47b2-af99-464dd6cf5912", "date": "Mon, 09 Sep 2024 17:57:53 GMT"} })
75172024-09-09T17:57:53.617ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 182.413238ms iteration = 12 status = 0
75182024-09-09T17:57:53.617ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 182.773711ms iteration = 13 status = {}
75192024-09-09T17:57:53.618ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
75202024-09-09T17:57:53.618ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75212024-09-09T17:57:53.619ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "477c16dd-11bb-474c-9548-5a284ed1126c", "content-length": "26", "date": "Mon, 09 Sep 2024 17:57:53 GMT"} })
75222024-09-09T17:57:53.619ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75232024-09-09T17:57:53.621ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75242024-09-09T17:57:53.638ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
75252024-09-09T17:57:53.638ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
75262024-09-09T17:57:53.638ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 203.511423ms iteration = 12 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
75272024-09-09T17:57:53.644ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75282024-09-09T17:57:53.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75292024-09-09T17:57:53.649ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75302024-09-09T17:57:53.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75312024-09-09T17:57:53.651ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75322024-09-09T17:57:53.653ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75332024-09-09T17:57:53.653ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75342024-09-09T17:57:53.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75352024-09-09T17:57:53.655ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75362024-09-09T17:57:53.656ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75372024-09-09T17:57:53.656ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75382024-09-09T17:57:53.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75392024-09-09T17:57:53.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 236.508215ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
75402024-09-09T17:57:53.734ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f zone_address = fd00:1122:3344:101::2
75412024-09-09T17:57:53.734ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75422024-09-09T17:57:53.735ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
75432024-09-09T17:57:53.735ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2f382e95-c6f3-4fff-84df-f218c9b74633", "content-length": "26", "date": "Mon, 09 Sep 2024 17:57:53 GMT"} })
75442024-09-09T17:57:53.735ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75452024-09-09T17:57:53.735ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a6e4c740-c061-4306-9804-03d8210fc6b5", "content-length": "1", "date": "Mon, 09 Sep 2024 17:57:53 GMT"} })
75462024-09-09T17:57:53.738ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
75472024-09-09T17:57:53.738ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75482024-09-09T17:57:53.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75492024-09-09T17:57:53.740ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 306.232654ms iteration = 12 status = null
75502024-09-09T17:57:53.765ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
75512024-09-09T17:57:53.766ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aa03b52b-b935-4e5b-9c78-bea64a2e92b2", "content-length": "691", "date": "Mon, 09 Sep 2024 17:57:53 GMT"} })
75522024-09-09T17:57:53.766ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
75532024-09-09T17:57:53.766ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
75542024-09-09T17:57:53.766ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
75552024-09-09T17:57:53.768ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 333.137712ms iteration = 12 status = {}
75562024-09-09T17:57:53.772ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 338.527464ms iteration = 12 status = {}
75572024-09-09T17:57:53.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75582024-09-09T17:57:53.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75592024-09-09T17:57:53.885ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 8ddbbc53-8b49-46f3-8c46-10ed4300f6d2, rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e) } rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
75602024-09-09T17:57:53.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75612024-09-09T17:57:53.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75622024-09-09T17:57:53.895ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
75632024-09-09T17:57:53.896ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ed2659c3-5a42-443c-86a0-c0b7abec4205", "content-length": "121", "date": "Mon, 09 Sep 2024 17:57:53 GMT"} })
75642024-09-09T17:57:53.896ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
75652024-09-09T17:57:53.896ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e
75662024-09-09T17:57:53.897ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
75672024-09-09T17:57:53.897ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
75682024-09-09T17:57:53.897ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
75692024-09-09T17:57:53.897ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
75702024-09-09T17:57:53.897ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
75712024-09-09T17:57:53.897ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75722024-09-09T17:57:53.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75732024-09-09T17:57:53.899ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
75742024-09-09T17:57:53.899ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "87402fa1-8654-4940-99a7-a8697c11e264", "content-length": "2", "date": "Mon, 09 Sep 2024 17:57:53 GMT"} })
75752024-09-09T17:57:53.899ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
75762024-09-09T17:57:53.899ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "55a84c77-cea3-4abd-8862-2a6e0554b79b", "content-length": "51", "date": "Mon, 09 Sep 2024 17:57:53 GMT"} })
75772024-09-09T17:57:53.899ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
75782024-09-09T17:57:53.899ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
75792024-09-09T17:57:54.044ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4f873aaf-c6fc-40d4-a65e-2c3b490213c5", "date": "Mon, 09 Sep 2024 17:57:53 GMT"} })
75802024-09-09T17:57:54.044ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch = Switch0
75812024-09-09T17:57:54.044ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
75822024-09-09T17:57:54.044ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "af39b25d-59df-418a-adc6-03215f0cb5c2", "content-length": "667", "date": "Mon, 09 Sep 2024 17:57:53 GMT"} })
75832024-09-09T17:57:54.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75842024-09-09T17:57:54.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75852024-09-09T17:57:54.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75862024-09-09T17:57:54.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75872024-09-09T17:57:54.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75882024-09-09T17:57:54.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75892024-09-09T17:57:54.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75902024-09-09T17:57:54.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75912024-09-09T17:57:54.061ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 626.34636ms iteration = 12 status = {}
75922024-09-09T17:57:55.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1238 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = c5c7b7e4-a505-4319-9b4b-63ac849ebdcd response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
75932024-09-09T17:57:55.586ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
75942024-09-09T17:57:55.586ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
75952024-09-09T17:57:55.617ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
75962024-09-09T17:57:55.617ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:54409
75972024-09-09T17:57:55.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54409 req_id = 3d3fd49e-3d95-4c5c-a238-febbb9d78eee roles = RoleSet { roles: {} } uri = /metrics/producers
75982024-09-09T17:57:55.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54409 req_id = 3d3fd49e-3d95-4c5c-a238-febbb9d78eee resource = Database result = Ok(()) uri = /metrics/producers
75992024-09-09T17:57:55.650ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
76002024-09-09T17:57:55.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54409 req_id = 3d3fd49e-3d95-4c5c-a238-febbb9d78eee roles = RoleSet { roles: {} } uri = /metrics/producers
76012024-09-09T17:57:55.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54409 req_id = 3d3fd49e-3d95-4c5c-a238-febbb9d78eee resource = Database result = Ok(()) uri = /metrics/producers
76022024-09-09T17:57:55.679ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
76032024-09-09T17:57:55.680ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7a8456a8-8cdf-4854-a03e-4a25878d01ab", "date": "Mon, 09 Sep 2024 17:57:55 GMT"} })
76042024-09-09T17:57:55.680ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
76052024-09-09T17:57:55.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 64861 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54409 req_id = 3d3fd49e-3d95-4c5c-a238-febbb9d78eee response_code = 201 uri = /metrics/producers
76062024-09-09T17:57:55.682ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "3d3fd49e-3d95-4c5c-a238-febbb9d78eee", "content-length": "41", "date": "Mon, 09 Sep 2024 17:57:55 GMT"} })
76072024-09-09T17:57:55.684ZDEBGnexus (producer-registration-task): registered with nexus successfully
76082024-09-09T17:57:55.684ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
76092024-09-09T17:57:56.713ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:64734
76102024-09-09T17:57:56.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64734 req_id = f7beaf76-77f7-480d-98bc-e823c6ee66ce roles = RoleSet { roles: {} } uri = /metrics/producers
76112024-09-09T17:57:56.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64734 req_id = f7beaf76-77f7-480d-98bc-e823c6ee66ce resource = Database result = Ok(()) uri = /metrics/producers
76122024-09-09T17:57:56.746ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
76132024-09-09T17:57:56.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64734 req_id = f7beaf76-77f7-480d-98bc-e823c6ee66ce roles = RoleSet { roles: {} } uri = /metrics/producers
76142024-09-09T17:57:56.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64734 req_id = f7beaf76-77f7-480d-98bc-e823c6ee66ce resource = Database result = Ok(()) uri = /metrics/producers
76152024-09-09T17:57:56.778ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
76162024-09-09T17:57:56.779ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e9e666d7-32e2-4033-9b19-4fb756791fee", "date": "Mon, 09 Sep 2024 17:57:56 GMT"} })
76172024-09-09T17:57:56.779ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 283b8781-e2cd-4d76-a776-70a483efe054
76182024-09-09T17:57:56.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 68083 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64734 req_id = f7beaf76-77f7-480d-98bc-e823c6ee66ce response_code = 201 uri = /metrics/producers
76192024-09-09T17:58:03.434ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
76202024-09-09T17:58:03.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76212024-09-09T17:58:03.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76222024-09-09T17:58:03.435ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
76232024-09-09T17:58:03.435ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76242024-09-09T17:58:03.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76252024-09-09T17:58:03.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76262024-09-09T17:58:03.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76272024-09-09T17:58:03.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76282024-09-09T17:58:03.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76292024-09-09T17:58:03.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76302024-09-09T17:58:03.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76312024-09-09T17:58:03.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76322024-09-09T17:58:03.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76332024-09-09T17:58:03.463ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.543547ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76342024-09-09T17:58:03.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76352024-09-09T17:58:03.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
76362024-09-09T17:58:03.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76372024-09-09T17:58:03.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76382024-09-09T17:58:03.481ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
76392024-09-09T17:58:03.481ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.002206ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
76402024-09-09T17:58:05.684ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = b09deea7-24b4-4cd7-94b8-0efa42e8e3f4 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
76412024-09-09T17:58:13.436ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
76422024-09-09T17:58:13.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76432024-09-09T17:58:13.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76442024-09-09T17:58:13.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
76452024-09-09T17:58:13.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76462024-09-09T17:58:13.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76472024-09-09T17:58:13.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76482024-09-09T17:58:13.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76492024-09-09T17:58:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76502024-09-09T17:58:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76512024-09-09T17:58:13.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76522024-09-09T17:58:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76532024-09-09T17:58:13.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76542024-09-09T17:58:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76552024-09-09T17:58:13.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76562024-09-09T17:58:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
76572024-09-09T17:58:13.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76582024-09-09T17:58:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76592024-09-09T17:58:13.455ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
76602024-09-09T17:58:13.455ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.522468ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
76612024-09-09T17:58:13.476ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.610637ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76622024-09-09T17:58:15.684ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1256 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 144b4335-c1a9-41e0-83d0-1751df2fd16c response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
76632024-09-09T17:58:22.094ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:50308
76642024-09-09T17:58:22.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50308 req_id = 45155366-3315-47b8-b2cd-92ec36a1ab5b roles = RoleSet { roles: {} } uri = /metrics/producers
76652024-09-09T17:58:22.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50308 req_id = 45155366-3315-47b8-b2cd-92ec36a1ab5b resource = Database result = Ok(()) uri = /metrics/producers
76662024-09-09T17:58:22.128ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
76672024-09-09T17:58:22.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50308 req_id = 45155366-3315-47b8-b2cd-92ec36a1ab5b roles = RoleSet { roles: {} } uri = /metrics/producers
76682024-09-09T17:58:22.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50308 req_id = 45155366-3315-47b8-b2cd-92ec36a1ab5b resource = Database result = Ok(()) uri = /metrics/producers
76692024-09-09T17:58:22.159ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
76702024-09-09T17:58:22.160ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2a92c245-d0b2-40d3-b68c-25aa00f830e0", "date": "Mon, 09 Sep 2024 17:58:22 GMT"} })
76712024-09-09T17:58:22.160ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 1b80eb26-d978-4b89-a5d7-a50775a95a33
76722024-09-09T17:58:22.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 67188 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50308 req_id = 45155366-3315-47b8-b2cd-92ec36a1ab5b response_code = 201 uri = /metrics/producers
76732024-09-09T17:58:23.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
76742024-09-09T17:58:23.436ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
76752024-09-09T17:58:23.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76762024-09-09T17:58:23.436ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
76772024-09-09T17:58:23.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
76782024-09-09T17:58:23.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76792024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
76802024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
76812024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
76822024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
76832024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76842024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
76852024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
76862024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
76872024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76882024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76892024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
76902024-09-09T17:58:23.437ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b
76912024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.7\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b"}
76922024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
76932024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
76942024-09-09T17:58:23.437ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-09 17:48:23.437071378 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
76952024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
76962024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
76972024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
76982024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76992024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77002024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77012024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77022024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
77032024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77042024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
77052024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
77062024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
77072024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
77082024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
77092024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77102024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77112024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
77122024-09-09T17:58:23.437ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
77132024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
77142024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
77152024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
77162024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77172024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77182024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
77192024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
77202024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
77212024-09-09T17:58:23.437ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
77222024-09-09T17:58:23.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
77232024-09-09T17:58:23.437ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("21f5073c-362d-497d-ae9e-f6ab85374703.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("42b0964a-b1a3-443e-b006-c18e1ad8d003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 34025, tv_nsec: 35311553 } })
77242024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77252024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
77262024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
77272024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77282024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
77292024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77302024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
77312024-09-09T17:58:23.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("07c1bbdd-f080-4837-9528-41234be47bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 34025, tv_nsec: 35351143 } })
77322024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77332024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
77342024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
77352024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77362024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
77372024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77382024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
77392024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
77402024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
77412024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77422024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
77432024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77442024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
77452024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77462024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77472024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
77482024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77492024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
77502024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77512024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77522024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77532024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77542024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77552024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77562024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
77572024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77582024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77592024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77602024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
77612024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77622024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77632024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77642024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77652024-09-09T17:58:23.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77662024-09-09T17:58:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77672024-09-09T17:58:23.439ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77682024-09-09T17:58:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77692024-09-09T17:58:23.439ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77702024-09-09T17:58:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77712024-09-09T17:58:23.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77722024-09-09T17:58:23.440ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
77732024-09-09T17:58:23.440ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.978733ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
77742024-09-09T17:58:23.441ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.672518ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
77752024-09-09T17:58:23.442ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
77762024-09-09T17:58:23.442ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.10801ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
77772024-09-09T17:58:23.443ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 34025, tv_nsec: 40770415 } })
77782024-09-09T17:58:23.443ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-09 17:48:23.437071378 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
77792024-09-09T17:58:23.443ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.347657ms iteration = 7 status = {"expiration":"2024-09-09T17:48:23.437071378Z","pruned":[]}
77802024-09-09T17:58:23.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77812024-09-09T17:58:23.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77822024-09-09T17:58:23.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77832024-09-09T17:58:23.444ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77842024-09-09T17:58:23.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77852024-09-09T17:58:23.445ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 34025, tv_nsec: 42727066 } })
77862024-09-09T17:58:23.446ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
77872024-09-09T17:58:23.446ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
77882024-09-09T17:58:23.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77892024-09-09T17:58:23.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77902024-09-09T17:58:23.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77912024-09-09T17:58:23.449ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.176455ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
77922024-09-09T17:58:23.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
77932024-09-09T17:58:23.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77942024-09-09T17:58:23.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77952024-09-09T17:58:23.449ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77962024-09-09T17:58:23.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77972024-09-09T17:58:23.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77982024-09-09T17:58:23.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
77992024-09-09T17:58:23.451ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78002024-09-09T17:58:23.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78012024-09-09T17:58:23.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78022024-09-09T17:58:23.454ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78032024-09-09T17:58:23.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78042024-09-09T17:58:23.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78052024-09-09T17:58:23.456ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78062024-09-09T17:58:23.456ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78072024-09-09T17:58:23.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78082024-09-09T17:58:23.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
78092024-09-09T17:58:23.459ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78102024-09-09T17:58:23.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78112024-09-09T17:58:23.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78122024-09-09T17:58:23.473ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78132024-09-09T17:58:23.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78142024-09-09T17:58:23.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78152024-09-09T17:58:23.486ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 34025, tv_nsec: 83709206 } })
78162024-09-09T17:58:23.486ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
78172024-09-09T17:58:23.489ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78182024-09-09T17:58:23.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78192024-09-09T17:58:23.497ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78202024-09-09T17:58:23.500ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
78212024-09-09T17:58:23.500ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.415406ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
78222024-09-09T17:58:23.500ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78232024-09-09T17:58:23.501ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78242024-09-09T17:58:23.501ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
78252024-09-09T17:58:23.501ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
78262024-09-09T17:58:23.501ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.369691ms iteration = 7 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
78272024-09-09T17:58:23.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78282024-09-09T17:58:23.505ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78292024-09-09T17:58:23.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78302024-09-09T17:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78312024-09-09T17:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78322024-09-09T17:58:23.514ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.549909ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
78332024-09-09T17:58:23.521ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
78342024-09-09T17:58:23.521ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
78352024-09-09T17:58:23.521ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78362024-09-09T17:58:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78372024-09-09T17:58:23.529ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 91.246164ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
78382024-09-09T17:58:23.531ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78392024-09-09T17:58:23.532ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78402024-09-09T17:58:23.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78412024-09-09T17:58:23.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78422024-09-09T17:58:23.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78432024-09-09T17:58:23.533ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78442024-09-09T17:58:23.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78452024-09-09T17:58:23.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78462024-09-09T17:58:23.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78472024-09-09T17:58:23.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
78482024-09-09T17:58:23.536ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78492024-09-09T17:58:23.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78502024-09-09T17:58:23.536ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78512024-09-09T17:58:23.537ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78522024-09-09T17:58:23.538ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78532024-09-09T17:58:23.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78542024-09-09T17:58:23.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78552024-09-09T17:58:23.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
78562024-09-09T17:58:23.540ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78572024-09-09T17:58:23.540ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78582024-09-09T17:58:23.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78592024-09-09T17:58:23.541ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78602024-09-09T17:58:23.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
78612024-09-09T17:58:23.541ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78622024-09-09T17:58:23.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78632024-09-09T17:58:23.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78642024-09-09T17:58:23.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78652024-09-09T17:58:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
78662024-09-09T17:58:23.544ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
78672024-09-09T17:58:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
78682024-09-09T17:58:23.544ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78692024-09-09T17:58:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78702024-09-09T17:58:23.545ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78712024-09-09T17:58:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
78722024-09-09T17:58:23.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
78732024-09-09T17:58:23.547ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78742024-09-09T17:58:23.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78752024-09-09T17:58:23.547ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78762024-09-09T17:58:23.547ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 109.631482ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
78772024-09-09T17:58:23.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78782024-09-09T17:58:23.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
78792024-09-09T17:58:23.549ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78802024-09-09T17:58:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78812024-09-09T17:58:23.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78822024-09-09T17:58:23.556ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 118.195312ms iteration = 4 status = {"nsuccess":5}
78832024-09-09T17:58:23.557ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78842024-09-09T17:58:23.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78852024-09-09T17:58:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78862024-09-09T17:58:23.560ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 122.150215ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78872024-09-09T17:58:23.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78882024-09-09T17:58:23.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78892024-09-09T17:58:23.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78902024-09-09T17:58:23.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
78912024-09-09T17:58:23.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78922024-09-09T17:58:23.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78932024-09-09T17:58:23.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78942024-09-09T17:58:23.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78952024-09-09T17:58:23.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78962024-09-09T17:58:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
78972024-09-09T17:58:23.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78982024-09-09T17:58:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78992024-09-09T17:58:23.584ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
79002024-09-09T17:58:23.584ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
79012024-09-09T17:58:23.584ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
79022024-09-09T17:58:23.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79032024-09-09T17:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79042024-09-09T17:58:23.585ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 147.494905ms iteration = 13 status = 0
79052024-09-09T17:58:23.586ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
79062024-09-09T17:58:23.586ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
79072024-09-09T17:58:23.586ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 148.542171ms iteration = 13 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
79082024-09-09T17:58:23.587ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79092024-09-09T17:58:23.587ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79102024-09-09T17:58:23.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 149.228164ms iteration = 13 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
79112024-09-09T17:58:23.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79122024-09-09T17:58:23.588ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
79132024-09-09T17:58:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79142024-09-09T17:58:23.591ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79152024-09-09T17:58:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79162024-09-09T17:58:23.592ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
79172024-09-09T17:58:23.592ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 156.000804ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
79182024-09-09T17:58:23.593ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
79192024-09-09T17:58:23.593ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
79202024-09-09T17:58:23.593ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
79212024-09-09T17:58:23.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79222024-09-09T17:58:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79232024-09-09T17:58:23.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79242024-09-09T17:58:23.595ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
79252024-09-09T17:58:23.595ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 0 version = 2
79262024-09-09T17:58:23.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79272024-09-09T17:58:23.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79282024-09-09T17:58:23.596ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
79292024-09-09T17:58:23.596ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
79302024-09-09T17:58:23.596ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 159.038822ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
79312024-09-09T17:58:23.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79322024-09-09T17:58:23.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79332024-09-09T17:58:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79342024-09-09T17:58:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79352024-09-09T17:58:23.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79362024-09-09T17:58:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79372024-09-09T17:58:23.598ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
79382024-09-09T17:58:23.598ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79392024-09-09T17:58:23.599ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "41c7c56d-556a-4855-b8d0-d0dde4a3afbc", "content-length": "26", "date": "Mon, 09 Sep 2024 17:58:23 GMT"} })
79402024-09-09T17:58:23.599ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79412024-09-09T17:58:23.599ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79422024-09-09T17:58:23.600ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79432024-09-09T17:58:23.602ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
79442024-09-09T17:58:23.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79452024-09-09T17:58:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79462024-09-09T17:58:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79472024-09-09T17:58:23.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79482024-09-09T17:58:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79492024-09-09T17:58:23.606ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
79502024-09-09T17:58:23.606ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
79512024-09-09T17:58:23.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79522024-09-09T17:58:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79532024-09-09T17:58:23.607ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 1 version = 2
79542024-09-09T17:58:23.607ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
79552024-09-09T17:58:23.607ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-09 17:52:54.528560 UTC dns_group = external generation = 2
79562024-09-09T17:58:23.607ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 170.461388ms iteration = 8 status = {"generation":2}
79572024-09-09T17:58:23.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79582024-09-09T17:58:23.608ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
79592024-09-09T17:58:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79602024-09-09T17:58:23.612ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79612024-09-09T17:58:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79622024-09-09T17:58:23.616ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
79632024-09-09T17:58:23.616ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
79642024-09-09T17:58:23.616ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-09 17:52:53.875764 UTC dns_group = internal generation = 1
79652024-09-09T17:58:23.616ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 179.082289ms iteration = 8 status = {"generation":1}
79662024-09-09T17:58:23.621ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 183.427665ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
79672024-09-09T17:58:23.624ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
79682024-09-09T17:58:23.624ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79692024-09-09T17:58:23.624ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f8d157ed-1110-4efd-bc3a-642d766b4b2c", "content-length": "26", "date": "Mon, 09 Sep 2024 17:58:23 GMT"} })
79702024-09-09T17:58:23.624ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79712024-09-09T17:58:23.625ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79722024-09-09T17:58:23.643ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-09T17:52:21.456201Z, time_modified: 2024-09-09T17:52:21.456201Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }) }
79732024-09-09T17:58:23.643ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 206.51169ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]}},"default_endpoint":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
79742024-09-09T17:58:23.652ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79752024-09-09T17:58:23.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79762024-09-09T17:58:23.654ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79772024-09-09T17:58:23.656ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79782024-09-09T17:58:23.656ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79792024-09-09T17:58:23.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79802024-09-09T17:58:23.657ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79812024-09-09T17:58:23.659ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f zone_address = fd00:1122:3344:101::2
79822024-09-09T17:58:23.659ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79832024-09-09T17:58:23.659ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b93c3b4d-c4e0-42d5-8517-fd4625d386df", "content-length": "26", "date": "Mon, 09 Sep 2024 17:58:23 GMT"} })
79842024-09-09T17:58:23.659ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79852024-09-09T17:58:23.659ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79862024-09-09T17:58:23.659ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79872024-09-09T17:58:23.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79882024-09-09T17:58:23.660ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
79892024-09-09T17:58:23.676ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 239.027891ms iteration = 15 status = {"physical_disks_added":0}
79902024-09-09T17:58:23.798ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
79912024-09-09T17:58:23.860ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
79922024-09-09T17:58:23.860ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "73e4345c-fee4-44d6-a38e-1833057f2db5", "content-length": "1", "date": "Mon, 09 Sep 2024 17:58:23 GMT"} })
79932024-09-09T17:58:23.862ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79942024-09-09T17:58:23.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79952024-09-09T17:58:23.870ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 433.309579ms iteration = 13 status = null
79962024-09-09T17:58:23.897ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 460.7219ms iteration = 13 status = {}
79972024-09-09T17:58:23.913ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
79982024-09-09T17:58:23.913ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2b3b2b09-e590-4327-893e-54975c88a25a", "date": "Mon, 09 Sep 2024 17:58:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79992024-09-09T17:58:23.913ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80002024-09-09T17:58:23.916ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "38d53b11-b8d9-4963-89af-efafa63b1fd6", "date": "Mon, 09 Sep 2024 17:58:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80012024-09-09T17:58:23.916ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80022024-09-09T17:58:23.918ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80032024-09-09T17:58:23.918ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 481.376881ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
80042024-09-09T17:58:23.935ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80052024-09-09T17:58:23.936ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5a504dfe-9fb1-4d66-91e2-45a17812136a", "content-length": "372", "date": "Mon, 09 Sep 2024 17:58:23 GMT"} })
80062024-09-09T17:58:23.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80072024-09-09T17:58:23.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80082024-09-09T17:58:23.940ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80092024-09-09T17:58:23.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80102024-09-09T17:58:23.944ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80112024-09-09T17:58:23.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80122024-09-09T17:58:23.948ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80132024-09-09T17:58:23.948ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a57e55b9-7aea-4a41-a65b-d36f7616f349", "date": "Mon, 09 Sep 2024 17:58:23 GMT"} })
80142024-09-09T17:58:23.950ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 512.666224ms iteration = 14 status = {}
80152024-09-09T17:58:23.962ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
80162024-09-09T17:58:23.962ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "04418da9-9c9d-4bda-80e6-b0a7d209bfb2", "date": "Mon, 09 Sep 2024 17:58:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80172024-09-09T17:58:23.962ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80182024-09-09T17:58:23.965ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5f230acd-3335-42f0-9f0b-8ad0ad8e7e06", "date": "Mon, 09 Sep 2024 17:58:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80192024-09-09T17:58:23.965ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80202024-09-09T17:58:23.966ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "13a839e5-d6f8-49de-88aa-72ba8c647f89", "date": "Mon, 09 Sep 2024 17:58:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80212024-09-09T17:58:23.966ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80222024-09-09T17:58:23.967ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80232024-09-09T17:58:23.968ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 531.071192ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
80242024-09-09T17:58:23.981ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
80252024-09-09T17:58:23.981ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ed5cb17b-9f37-46d4-ae2e-140e390fd378", "content-length": "691", "date": "Mon, 09 Sep 2024 17:58:23 GMT"} })
80262024-09-09T17:58:23.981ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
80272024-09-09T17:58:23.981ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
80282024-09-09T17:58:23.981ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
80292024-09-09T17:58:23.982ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 544.931453ms iteration = 13 status = {}
80302024-09-09T17:58:24.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80312024-09-09T17:58:24.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80322024-09-09T17:58:24.046ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 8ddbbc53-8b49-46f3-8c46-10ed4300f6d2, rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e) } rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
80332024-09-09T17:58:24.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80342024-09-09T17:58:24.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80352024-09-09T17:58:24.056ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
80362024-09-09T17:58:24.057ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "be3b0c7b-5164-4885-a31c-310d6032e1f7", "content-length": "121", "date": "Mon, 09 Sep 2024 17:58:23 GMT"} })
80372024-09-09T17:58:24.057ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
80382024-09-09T17:58:24.057ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e
80392024-09-09T17:58:24.057ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80402024-09-09T17:58:24.057ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80412024-09-09T17:58:24.057ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
80422024-09-09T17:58:24.057ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
80432024-09-09T17:58:24.057ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
80442024-09-09T17:58:24.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80452024-09-09T17:58:24.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80462024-09-09T17:58:24.060ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
80472024-09-09T17:58:24.060ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0208980e-69d2-47bb-857f-83660cef3284", "content-length": "2", "date": "Mon, 09 Sep 2024 17:58:23 GMT"} })
80482024-09-09T17:58:24.060ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
80492024-09-09T17:58:24.060ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e704635f-a1ad-4ef5-9ae6-3d5b2e003480", "content-length": "51", "date": "Mon, 09 Sep 2024 17:58:23 GMT"} })
80502024-09-09T17:58:24.060ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
80512024-09-09T17:58:24.060ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
80522024-09-09T17:58:24.192ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4ff3f272-4ea4-449c-a3c6-f16f7400bc3b", "date": "Mon, 09 Sep 2024 17:58:23 GMT"} })
80532024-09-09T17:58:24.192ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch = Switch0
80542024-09-09T17:58:24.192ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
80552024-09-09T17:58:24.192ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd22f502-0f70-4af3-aaf9-a77deb637755", "content-length": "667", "date": "Mon, 09 Sep 2024 17:58:24 GMT"} })
80562024-09-09T17:58:24.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80572024-09-09T17:58:24.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80582024-09-09T17:58:24.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80592024-09-09T17:58:24.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80602024-09-09T17:58:24.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80612024-09-09T17:58:24.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80622024-09-09T17:58:24.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80632024-09-09T17:58:24.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80642024-09-09T17:58:24.209ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 772.125904ms iteration = 13 status = {}
80652024-09-09T17:58:25.684ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1116 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 90835a08-a767-49ad-9b88-0fbec19a4e73 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
80662024-09-09T17:58:33.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
80672024-09-09T17:58:33.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80682024-09-09T17:58:33.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80692024-09-09T17:58:33.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
80702024-09-09T17:58:33.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80712024-09-09T17:58:33.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80722024-09-09T17:58:33.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80732024-09-09T17:58:33.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80742024-09-09T17:58:33.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80752024-09-09T17:58:33.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80762024-09-09T17:58:33.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80772024-09-09T17:58:33.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80782024-09-09T17:58:33.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80792024-09-09T17:58:33.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
80802024-09-09T17:58:33.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80812024-09-09T17:58:33.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80822024-09-09T17:58:33.460ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
80832024-09-09T17:58:33.460ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.435738ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
80842024-09-09T17:58:33.467ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80852024-09-09T17:58:33.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80862024-09-09T17:58:33.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.997232ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80872024-09-09T17:58:35.685ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1149 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 25d59a7e-aa0d-471a-abdb-9760c0f407e3 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
80882024-09-09T17:58:43.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
80892024-09-09T17:58:43.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80902024-09-09T17:58:43.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80912024-09-09T17:58:43.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
80922024-09-09T17:58:43.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80932024-09-09T17:58:43.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80942024-09-09T17:58:43.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80952024-09-09T17:58:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80962024-09-09T17:58:43.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80972024-09-09T17:58:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80982024-09-09T17:58:43.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80992024-09-09T17:58:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81002024-09-09T17:58:43.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81012024-09-09T17:58:43.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
81022024-09-09T17:58:43.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81032024-09-09T17:58:43.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81042024-09-09T17:58:43.457ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
81052024-09-09T17:58:43.457ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.122998ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
81062024-09-09T17:58:43.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81072024-09-09T17:58:43.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81082024-09-09T17:58:43.465ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.635292ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81092024-09-09T17:58:45.685ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1141 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 84ed0fb5-af0c-446a-8d07-ce3155acf50f response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
81102024-09-09T17:58:53.437ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
81112024-09-09T17:58:53.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
81122024-09-09T17:58:53.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81132024-09-09T17:58:53.437ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
81142024-09-09T17:58:53.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
81152024-09-09T17:58:53.437ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
81162024-09-09T17:58:53.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81172024-09-09T17:58:53.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81182024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
81192024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81202024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
81212024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
81222024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81232024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
81242024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
81252024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
81262024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81272024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81282024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
81292024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81302024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
81312024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81322024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
81332024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81342024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
81352024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
81362024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81372024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81382024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
81392024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
81402024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
81412024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
81422024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81432024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81442024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
81452024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
81462024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81472024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
81482024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81492024-09-09T17:58:53.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81502024-09-09T17:58:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81512024-09-09T17:58:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81522024-09-09T17:58:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81532024-09-09T17:58:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81542024-09-09T17:58:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81552024-09-09T17:58:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
81562024-09-09T17:58:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81572024-09-09T17:58:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81582024-09-09T17:58:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81592024-09-09T17:58:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81602024-09-09T17:58:53.440ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.202809ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
81612024-09-09T17:58:53.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 34055, tv_nsec: 37866993 } })
81622024-09-09T17:58:53.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
81632024-09-09T17:58:53.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81642024-09-09T17:58:53.442ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 34055, tv_nsec: 39162440 } })
81652024-09-09T17:58:53.442ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
81662024-09-09T17:58:53.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81672024-09-09T17:58:53.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81682024-09-09T17:58:53.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81692024-09-09T17:58:53.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81702024-09-09T17:58:53.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
81712024-09-09T17:58:53.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81722024-09-09T17:58:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81732024-09-09T17:58:53.447ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81742024-09-09T17:58:53.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81752024-09-09T17:58:53.450ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81762024-09-09T17:58:53.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
81772024-09-09T17:58:53.450ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81782024-09-09T17:58:53.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81792024-09-09T17:58:53.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
81802024-09-09T17:58:53.453ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81812024-09-09T17:58:53.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81822024-09-09T17:58:53.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81832024-09-09T17:58:53.454ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81842024-09-09T17:58:53.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81852024-09-09T17:58:53.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81862024-09-09T17:58:53.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81872024-09-09T17:58:53.460ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 34055, tv_nsec: 57664999 } })
81882024-09-09T17:58:53.461ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
81892024-09-09T17:58:53.461ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81902024-09-09T17:58:53.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81912024-09-09T17:58:53.471ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81922024-09-09T17:58:53.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81932024-09-09T17:58:53.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.096001ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
81942024-09-09T17:58:53.497ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81952024-09-09T17:58:53.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81962024-09-09T17:58:53.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.601605ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81972024-09-09T17:58:53.500ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81982024-09-09T17:58:53.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81992024-09-09T17:58:53.501ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82002024-09-09T17:58:53.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82012024-09-09T17:58:53.501ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82022024-09-09T17:58:53.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82032024-09-09T17:58:53.504ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.396653ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
82042024-09-09T17:58:53.504ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82052024-09-09T17:58:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82062024-09-09T17:58:53.505ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82072024-09-09T17:58:53.506ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
82082024-09-09T17:58:53.506ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
82092024-09-09T17:58:53.506ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82102024-09-09T17:58:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82112024-09-09T17:58:53.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82122024-09-09T17:58:53.507ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82132024-09-09T17:58:53.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82142024-09-09T17:58:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82152024-09-09T17:58:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82162024-09-09T17:58:53.509ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82172024-09-09T17:58:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82182024-09-09T17:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82192024-09-09T17:58:53.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
82202024-09-09T17:58:53.515ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82212024-09-09T17:58:53.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82222024-09-09T17:58:53.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82232024-09-09T17:58:53.517ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 78.628461ms iteration = 14 status = 0
82242024-09-09T17:58:53.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
82252024-09-09T17:58:53.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82262024-09-09T17:58:53.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82272024-09-09T17:58:53.525ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82282024-09-09T17:58:53.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82292024-09-09T17:58:53.528ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82302024-09-09T17:58:53.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82312024-09-09T17:58:53.538ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
82322024-09-09T17:58:53.538ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.71206ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
82332024-09-09T17:58:53.550ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 112.040636ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
82342024-09-09T17:58:53.550ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
82352024-09-09T17:58:53.550ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82362024-09-09T17:58:53.551ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "29647be3-dfad-4c2d-87db-62392bb0f485", "content-length": "26", "date": "Mon, 09 Sep 2024 17:58:53 GMT"} })
82372024-09-09T17:58:53.551ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82382024-09-09T17:58:53.551ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
82392024-09-09T17:58:53.551ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82402024-09-09T17:58:53.551ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 112.968362ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
82412024-09-09T17:58:53.551ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "01a69425-5ef6-4a18-9068-214d75573365", "content-length": "26", "date": "Mon, 09 Sep 2024 17:58:53 GMT"} })
82422024-09-09T17:58:53.551ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82432024-09-09T17:58:53.553ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82442024-09-09T17:58:53.554ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82452024-09-09T17:58:53.554ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.89979ms iteration = 14 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
82462024-09-09T17:58:53.554ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
82472024-09-09T17:58:53.554ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
82482024-09-09T17:58:53.554ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 115.806069ms iteration = 14 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
82492024-09-09T17:58:53.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82502024-09-09T17:58:53.557ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82512024-09-09T17:58:53.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82522024-09-09T17:58:53.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82532024-09-09T17:58:53.562ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
82542024-09-09T17:58:53.562ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 124.176708ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
82552024-09-09T17:58:53.563ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f zone_address = fd00:1122:3344:101::2
82562024-09-09T17:58:53.563ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82572024-09-09T17:58:53.564ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b822cb1a-705d-49c9-b0b0-02e32152f4f9", "content-length": "26", "date": "Mon, 09 Sep 2024 17:58:53 GMT"} })
82582024-09-09T17:58:53.564ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82592024-09-09T17:58:53.565ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
82602024-09-09T17:58:53.587ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82612024-09-09T17:58:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82622024-09-09T17:58:53.625ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 187.298748ms iteration = 16 status = {"physical_disks_added":0}
82632024-09-09T17:58:53.658ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
82642024-09-09T17:58:53.658ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a1601b36-b276-41a2-beca-2aafbc11fdde", "content-length": "1", "date": "Mon, 09 Sep 2024 17:58:53 GMT"} })
82652024-09-09T17:58:53.659ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82662024-09-09T17:58:53.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82672024-09-09T17:58:53.661ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 223.875332ms iteration = 14 status = null
82682024-09-09T17:58:53.667ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 230.150869ms iteration = 14 status = {}
82692024-09-09T17:58:53.667ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82702024-09-09T17:58:53.668ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f04590a6-b7a4-4e95-a7ac-1fdc42f2d61a", "content-length": "372", "date": "Mon, 09 Sep 2024 17:58:53 GMT"} })
82712024-09-09T17:58:53.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82722024-09-09T17:58:53.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82732024-09-09T17:58:53.671ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82742024-09-09T17:58:53.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82752024-09-09T17:58:53.673ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82762024-09-09T17:58:53.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82772024-09-09T17:58:53.675ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82782024-09-09T17:58:53.675ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82792024-09-09T17:58:53.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82802024-09-09T17:58:53.677ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82812024-09-09T17:58:53.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82822024-09-09T17:58:53.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82832024-09-09T17:58:53.678ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82842024-09-09T17:58:53.678ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7370d927-1cb2-4d40-9d49-b442a8064a6b", "date": "Mon, 09 Sep 2024 17:58:53 GMT"} })
82852024-09-09T17:58:53.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82862024-09-09T17:58:53.680ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 241.843247ms iteration = 15 status = {}
82872024-09-09T17:58:53.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82882024-09-09T17:58:53.680ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82892024-09-09T17:58:53.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82902024-09-09T17:58:53.741ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
82912024-09-09T17:58:53.741ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "18d566e3-9d28-4356-8f2b-3479b6dd37e9", "content-length": "691", "date": "Mon, 09 Sep 2024 17:58:53 GMT"} })
82922024-09-09T17:58:53.741ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
82932024-09-09T17:58:53.741ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
82942024-09-09T17:58:53.741ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
82952024-09-09T17:58:53.742ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 304.004141ms iteration = 14 status = {}
82962024-09-09T17:58:53.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82972024-09-09T17:58:53.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82982024-09-09T17:58:53.761ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 8ddbbc53-8b49-46f3-8c46-10ed4300f6d2, rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e) } rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
82992024-09-09T17:58:53.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83002024-09-09T17:58:53.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83012024-09-09T17:58:53.771ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
83022024-09-09T17:58:53.771ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "255b52df-b3cd-409b-b402-2c31e3780fd9", "content-length": "121", "date": "Mon, 09 Sep 2024 17:58:53 GMT"} })
83032024-09-09T17:58:53.771ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
83042024-09-09T17:58:53.771ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e
83052024-09-09T17:58:53.771ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
83062024-09-09T17:58:53.771ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
83072024-09-09T17:58:53.771ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
83082024-09-09T17:58:53.771ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
83092024-09-09T17:58:53.771ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
83102024-09-09T17:58:53.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83112024-09-09T17:58:53.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83122024-09-09T17:58:53.774ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
83132024-09-09T17:58:53.774ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1c45929b-1d5e-4c11-8914-9a2a3999b027", "content-length": "2", "date": "Mon, 09 Sep 2024 17:58:53 GMT"} })
83142024-09-09T17:58:53.774ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
83152024-09-09T17:58:53.775ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cf06a7fc-42db-4fa5-961a-070cf8547544", "content-length": "51", "date": "Mon, 09 Sep 2024 17:58:53 GMT"} })
83162024-09-09T17:58:53.775ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
83172024-09-09T17:58:53.775ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
83182024-09-09T17:58:53.878ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5d5a2c7a-6013-4a05-aaa8-44bde781639b", "date": "Mon, 09 Sep 2024 17:58:53 GMT"} })
83192024-09-09T17:58:53.878ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch = Switch0
83202024-09-09T17:58:53.878ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
83212024-09-09T17:58:53.883ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bc5b8ab3-6d3e-4146-be03-c337769a81c3", "content-length": "667", "date": "Mon, 09 Sep 2024 17:58:53 GMT"} })
83222024-09-09T17:58:53.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83232024-09-09T17:58:53.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83242024-09-09T17:58:53.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83252024-09-09T17:58:53.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83262024-09-09T17:58:53.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83272024-09-09T17:58:53.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83282024-09-09T17:58:53.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83292024-09-09T17:58:53.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83302024-09-09T17:58:53.900ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 461.481034ms iteration = 14 status = {}
83312024-09-09T17:58:55.686ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1320 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = d721d3ed-3acd-4b1a-9ef5-b2175ff3e9b2 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
83322024-09-09T17:59:03.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
83332024-09-09T17:59:03.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83342024-09-09T17:59:03.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
83352024-09-09T17:59:03.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83362024-09-09T17:59:03.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83372024-09-09T17:59:03.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83382024-09-09T17:59:03.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83392024-09-09T17:59:03.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83402024-09-09T17:59:03.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83412024-09-09T17:59:03.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83422024-09-09T17:59:03.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83432024-09-09T17:59:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83442024-09-09T17:59:03.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83452024-09-09T17:59:03.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
83462024-09-09T17:59:03.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83472024-09-09T17:59:03.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83482024-09-09T17:59:03.458ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
83492024-09-09T17:59:03.458ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.319259ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
83502024-09-09T17:59:03.467ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83512024-09-09T17:59:03.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83522024-09-09T17:59:03.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.618598ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83532024-09-09T17:59:05.686ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1310 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 01bd3916-1272-4144-8d3a-f6a0ccea3a44 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
83542024-09-09T17:59:07.375ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:35367
83552024-09-09T17:59:07.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:35367 req_id = 619d7114-4dec-454e-ba47-53d680c2dccf roles = RoleSet { roles: {} } uri = /metrics/producers
83562024-09-09T17:59:07.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:35367 req_id = 619d7114-4dec-454e-ba47-53d680c2dccf resource = Database result = Ok(()) uri = /metrics/producers
83572024-09-09T17:59:07.409ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
83582024-09-09T17:59:07.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:35367 req_id = 619d7114-4dec-454e-ba47-53d680c2dccf roles = RoleSet { roles: {} } uri = /metrics/producers
83592024-09-09T17:59:07.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:35367 req_id = 619d7114-4dec-454e-ba47-53d680c2dccf resource = Database result = Ok(()) uri = /metrics/producers
83602024-09-09T17:59:07.559ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
83612024-09-09T17:59:07.560ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "332fcc78-bc55-42ef-be96-dca7012863ee", "date": "Mon, 09 Sep 2024 17:59:07 GMT"} })
83622024-09-09T17:59:07.560ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11
83632024-09-09T17:59:07.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 185783 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:35367 req_id = 619d7114-4dec-454e-ba47-53d680c2dccf response_code = 201 uri = /metrics/producers
83642024-09-09T17:59:07.577ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:44885
83652024-09-09T17:59:07.604ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 760054d9-c981-48b3-88ba-f2e26d33bb6c remote_addr = [fd00:1122:3344:101::1]:44885 req_id = ed8c2134-9294-4fde-8e96-b5e0c38929ae uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-09-09T17:59:07.562006285Z }
83662024-09-09T17:59:07.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = ed8c2134-9294-4fde-8e96-b5e0c38929ae roles = RoleSet { roles: {} } uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
83672024-09-09T17:59:07.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = ed8c2134-9294-4fde-8e96-b5e0c38929ae resource = Database result = Ok(()) uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
83682024-09-09T17:59:07.604ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:58817
83692024-09-09T17:59:07.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 133314 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = ed8c2134-9294-4fde-8e96-b5e0c38929ae response_code = 204 uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
83702024-09-09T17:59:08.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = a57d9d2f-2971-4dd8-afe6-eed0ad7b68cf roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
83712024-09-09T17:59:08.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = a57d9d2f-2971-4dd8-afe6-eed0ad7b68cf resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
83722024-09-09T17:59:08.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 11497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = a57d9d2f-2971-4dd8-afe6-eed0ad7b68cf response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
83732024-09-09T17:59:09.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3f386148-f1d7-404a-931d-867ec6ab1108 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
83742024-09-09T17:59:09.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3f386148-f1d7-404a-931d-867ec6ab1108 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
83752024-09-09T17:59:09.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3f386148-f1d7-404a-931d-867ec6ab1108 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
83762024-09-09T17:59:10.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = c0064ff6-3f87-45da-9bfa-003b626c4e89 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
83772024-09-09T17:59:10.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = c0064ff6-3f87-45da-9bfa-003b626c4e89 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
83782024-09-09T17:59:10.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = c0064ff6-3f87-45da-9bfa-003b626c4e89 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
83792024-09-09T17:59:11.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3e965206-6170-4549-a10d-17d2e58e0cb4 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
83802024-09-09T17:59:11.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3e965206-6170-4549-a10d-17d2e58e0cb4 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
83812024-09-09T17:59:11.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2881 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3e965206-6170-4549-a10d-17d2e58e0cb4 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
83822024-09-09T17:59:12.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f05d407f-45d7-41da-9891-a16aa2b03c07 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
83832024-09-09T17:59:12.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f05d407f-45d7-41da-9891-a16aa2b03c07 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
83842024-09-09T17:59:12.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f05d407f-45d7-41da-9891-a16aa2b03c07 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
83852024-09-09T17:59:13.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
83862024-09-09T17:59:13.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83872024-09-09T17:59:13.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83882024-09-09T17:59:13.439ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
83892024-09-09T17:59:13.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83902024-09-09T17:59:13.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83912024-09-09T17:59:13.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83922024-09-09T17:59:13.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83932024-09-09T17:59:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83942024-09-09T17:59:13.443ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.164844ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83952024-09-09T17:59:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83962024-09-09T17:59:13.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83972024-09-09T17:59:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83982024-09-09T17:59:13.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83992024-09-09T17:59:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84002024-09-09T17:59:13.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84012024-09-09T17:59:13.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
84022024-09-09T17:59:13.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84032024-09-09T17:59:13.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84042024-09-09T17:59:13.456ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
84052024-09-09T17:59:13.456ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.657464ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
84062024-09-09T17:59:13.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 02733327-f3d4-47f3-9aa5-e20654a26617 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84072024-09-09T17:59:13.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 02733327-f3d4-47f3-9aa5-e20654a26617 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84082024-09-09T17:59:13.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 02733327-f3d4-47f3-9aa5-e20654a26617 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84092024-09-09T17:59:14.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3904af90-edb5-4eb3-8bda-46843066f226 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84102024-09-09T17:59:14.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3904af90-edb5-4eb3-8bda-46843066f226 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84112024-09-09T17:59:14.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3904af90-edb5-4eb3-8bda-46843066f226 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84122024-09-09T17:59:15.686ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1510 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = c481bf2d-911e-4e41-8978-2fd902f3fc86 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
84132024-09-09T17:59:15.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b62697c1-60f1-4d3f-808b-3b3786a11c95 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84142024-09-09T17:59:15.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b62697c1-60f1-4d3f-808b-3b3786a11c95 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84152024-09-09T17:59:15.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b62697c1-60f1-4d3f-808b-3b3786a11c95 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84162024-09-09T17:59:16.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 56d2bea1-0468-4f08-890b-13485beb49da roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84172024-09-09T17:59:16.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 56d2bea1-0468-4f08-890b-13485beb49da resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84182024-09-09T17:59:16.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 56d2bea1-0468-4f08-890b-13485beb49da response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84192024-09-09T17:59:17.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f66743b6-87c9-450f-b31b-168a251e71cc roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84202024-09-09T17:59:17.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f66743b6-87c9-450f-b31b-168a251e71cc resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84212024-09-09T17:59:17.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f66743b6-87c9-450f-b31b-168a251e71cc response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84222024-09-09T17:59:18.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1c00e104-f79f-4ced-b975-2eee6de5bccd roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84232024-09-09T17:59:18.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1c00e104-f79f-4ced-b975-2eee6de5bccd resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84242024-09-09T17:59:18.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1c00e104-f79f-4ced-b975-2eee6de5bccd response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84252024-09-09T17:59:19.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f8f2c242-d838-4c4a-ad13-bf67dc8a4eba roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84262024-09-09T17:59:19.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f8f2c242-d838-4c4a-ad13-bf67dc8a4eba resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84272024-09-09T17:59:19.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f8f2c242-d838-4c4a-ad13-bf67dc8a4eba response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84282024-09-09T17:59:20.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3947f514-279d-45c3-a30d-e546aea2a697 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84292024-09-09T17:59:20.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3947f514-279d-45c3-a30d-e546aea2a697 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84302024-09-09T17:59:20.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3947f514-279d-45c3-a30d-e546aea2a697 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84312024-09-09T17:59:21.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 82a081fe-f7e9-4b04-9c69-030bfa0237b1 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84322024-09-09T17:59:21.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 82a081fe-f7e9-4b04-9c69-030bfa0237b1 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84332024-09-09T17:59:21.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 82a081fe-f7e9-4b04-9c69-030bfa0237b1 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84342024-09-09T17:59:22.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = a7f937fc-2c17-47ea-a4c3-207af0b8123d roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84352024-09-09T17:59:22.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = a7f937fc-2c17-47ea-a4c3-207af0b8123d resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84362024-09-09T17:59:22.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = a7f937fc-2c17-47ea-a4c3-207af0b8123d response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
84372024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
84382024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
84392024-09-09T17:59:23.438ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-09 17:49:23.438451858 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
84402024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84412024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
84422024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
84432024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
84442024-09-09T17:59:23.438ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b
84452024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
84462024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.48\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b"}
84472024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
84482024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
84492024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84502024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
84512024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84522024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
84532024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84542024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
84552024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
84562024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
84572024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
84582024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
84592024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
84602024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
84612024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84622024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
84632024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84642024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84652024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84662024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84672024-09-09T17:59:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84682024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84692024-09-09T17:59:23.439ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("07c1bbdd-f080-4837-9528-41234be47bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 34085, tv_nsec: 35225611 } })
84702024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
84712024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
84722024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84732024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
84742024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
84752024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84762024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84772024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
84782024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
84792024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
84802024-09-09T17:59:23.439ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
84812024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
84822024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84832024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84842024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
84852024-09-09T17:59:23.439ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
84862024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
84872024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
84882024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84892024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
84902024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84912024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
84922024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84932024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
84942024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
84952024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
84962024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84972024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
84982024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84992024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
85002024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
85012024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
85022024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85032024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85042024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85052024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
85062024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85072024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
85082024-09-09T17:59:23.439ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("21f5073c-362d-497d-ae9e-f6ab85374703.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("42b0964a-b1a3-443e-b006-c18e1ad8d003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 34085, tv_nsec: 35603243 } })
85092024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85102024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85112024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85122024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
85132024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
85142024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85152024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85162024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85172024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85182024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85192024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
85202024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85212024-09-09T17:59:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85222024-09-09T17:59:23.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85232024-09-09T17:59:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85242024-09-09T17:59:23.441ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-09 17:49:23.438451858 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
85252024-09-09T17:59:23.441ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.184029ms iteration = 8 status = {"expiration":"2024-09-09T17:49:23.438451858Z","pruned":[]}
85262024-09-09T17:59:23.441ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
85272024-09-09T17:59:23.441ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.300749ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
85282024-09-09T17:59:23.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85292024-09-09T17:59:23.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85302024-09-09T17:59:23.443ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
85312024-09-09T17:59:23.443ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.531337ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
85322024-09-09T17:59:23.443ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.565577ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85332024-09-09T17:59:23.443ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85342024-09-09T17:59:23.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85352024-09-09T17:59:23.444ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 34085, tv_nsec: 40466972 } })
85362024-09-09T17:59:23.444ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 34085, tv_nsec: 40650143 } })
85372024-09-09T17:59:23.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85382024-09-09T17:59:23.446ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85392024-09-09T17:59:23.446ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85402024-09-09T17:59:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85412024-09-09T17:59:23.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85422024-09-09T17:59:23.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85432024-09-09T17:59:23.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85442024-09-09T17:59:23.447ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
85452024-09-09T17:59:23.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85462024-09-09T17:59:23.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85472024-09-09T17:59:23.447ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
85482024-09-09T17:59:23.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85492024-09-09T17:59:23.449ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85502024-09-09T17:59:23.451ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85512024-09-09T17:59:23.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85522024-09-09T17:59:23.451ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85532024-09-09T17:59:23.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85542024-09-09T17:59:23.452ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85552024-09-09T17:59:23.455ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85562024-09-09T17:59:23.455ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85572024-09-09T17:59:23.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
85582024-09-09T17:59:23.455ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
85592024-09-09T17:59:23.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85602024-09-09T17:59:23.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
85612024-09-09T17:59:23.458ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85622024-09-09T17:59:23.461ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85632024-09-09T17:59:23.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85642024-09-09T17:59:23.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85652024-09-09T17:59:23.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85662024-09-09T17:59:23.462ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.639839ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
85672024-09-09T17:59:23.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85682024-09-09T17:59:23.463ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85692024-09-09T17:59:23.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85702024-09-09T17:59:23.464ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 34085, tv_nsec: 60888092 } })
85712024-09-09T17:59:23.464ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85722024-09-09T17:59:23.465ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
85732024-09-09T17:59:23.466ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85742024-09-09T17:59:23.466ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 26.763656ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
85752024-09-09T17:59:23.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85762024-09-09T17:59:23.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
85772024-09-09T17:59:23.473ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85782024-09-09T17:59:23.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85792024-09-09T17:59:23.475ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85802024-09-09T17:59:23.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85812024-09-09T17:59:23.480ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85822024-09-09T17:59:23.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85832024-09-09T17:59:23.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.497226ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
85842024-09-09T17:59:23.502ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85852024-09-09T17:59:23.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85862024-09-09T17:59:23.506ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.080433ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
85872024-09-09T17:59:23.509ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
85882024-09-09T17:59:23.510ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
85892024-09-09T17:59:23.510ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85902024-09-09T17:59:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85912024-09-09T17:59:23.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85922024-09-09T17:59:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85932024-09-09T17:59:23.515ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
85942024-09-09T17:59:23.515ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
85952024-09-09T17:59:23.515ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
85962024-09-09T17:59:23.515ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85972024-09-09T17:59:23.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85982024-09-09T17:59:23.517ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85992024-09-09T17:59:23.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86002024-09-09T17:59:23.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86012024-09-09T17:59:23.517ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86022024-09-09T17:59:23.518ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86032024-09-09T17:59:23.521ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86042024-09-09T17:59:23.521ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86052024-09-09T17:59:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86062024-09-09T17:59:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86072024-09-09T17:59:23.522ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86082024-09-09T17:59:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
86092024-09-09T17:59:23.522ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86102024-09-09T17:59:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86112024-09-09T17:59:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
86122024-09-09T17:59:23.523ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86132024-09-09T17:59:23.523ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
86142024-09-09T17:59:23.523ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
86152024-09-09T17:59:23.523ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 84.718696ms iteration = 8 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
86162024-09-09T17:59:23.525ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86172024-09-09T17:59:23.525ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
86182024-09-09T17:59:23.525ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 0 version = 2
86192024-09-09T17:59:23.525ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86202024-09-09T17:59:23.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86212024-09-09T17:59:23.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
86222024-09-09T17:59:23.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
86232024-09-09T17:59:23.528ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86242024-09-09T17:59:23.528ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.189793ms iteration = 15 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
86252024-09-09T17:59:23.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86262024-09-09T17:59:23.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86272024-09-09T17:59:23.531ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86282024-09-09T17:59:23.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86292024-09-09T17:59:23.532ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
86302024-09-09T17:59:23.532ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
86312024-09-09T17:59:23.532ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 93.402247ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
86322024-09-09T17:59:23.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86332024-09-09T17:59:23.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86342024-09-09T17:59:23.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86352024-09-09T17:59:23.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86362024-09-09T17:59:23.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
86372024-09-09T17:59:23.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86382024-09-09T17:59:23.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86392024-09-09T17:59:23.537ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 1 version = 2
86402024-09-09T17:59:23.537ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
86412024-09-09T17:59:23.537ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-09 17:52:54.528560 UTC dns_group = external generation = 2
86422024-09-09T17:59:23.537ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 98.800739ms iteration = 9 status = {"generation":2}
86432024-09-09T17:59:23.538ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86442024-09-09T17:59:23.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86452024-09-09T17:59:23.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 110.017285ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86462024-09-09T17:59:23.549ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
86472024-09-09T17:59:23.549ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 110.816249ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
86482024-09-09T17:59:23.562ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86492024-09-09T17:59:23.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86502024-09-09T17:59:23.564ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86512024-09-09T17:59:23.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86522024-09-09T17:59:23.572ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
86532024-09-09T17:59:23.572ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86542024-09-09T17:59:23.573ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 133.869024ms iteration = 15 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
86552024-09-09T17:59:23.576ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
86562024-09-09T17:59:23.576ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
86572024-09-09T17:59:23.576ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
86582024-09-09T17:59:23.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86592024-09-09T17:59:23.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86602024-09-09T17:59:23.603ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86612024-09-09T17:59:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86622024-09-09T17:59:23.616ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 177.009627ms iteration = 17 status = {"physical_disks_added":0}
86632024-09-09T17:59:23.653ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
86642024-09-09T17:59:23.653ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86652024-09-09T17:59:23.654ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c25920df-7b76-467c-b745-a8c40bbad532", "content-length": "26", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} })
86662024-09-09T17:59:23.654ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86672024-09-09T17:59:23.656ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86682024-09-09T17:59:23.665ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f zone_address = fd00:1122:3344:101::2
86692024-09-09T17:59:23.665ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86702024-09-09T17:59:23.665ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d9f31911-3a63-4286-928e-8e02ef150e58", "content-length": "26", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} })
86712024-09-09T17:59:23.665ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86722024-09-09T17:59:23.667ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
86732024-09-09T17:59:23.689ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
86742024-09-09T17:59:23.689ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86752024-09-09T17:59:23.689ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fd50199e-068b-42a6-b5cc-cd2ce0ce6ac5", "content-length": "26", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} })
86762024-09-09T17:59:23.689ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86772024-09-09T17:59:23.691ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86782024-09-09T17:59:23.731ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
86792024-09-09T17:59:23.753ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
86802024-09-09T17:59:23.797ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c/state
86812024-09-09T17:59:23.799ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "46f30c23-53db-4f86-a5a2-3696900f2dc4", "content-length": "130", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} })
86822024-09-09T17:59:23.803ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 state = Running
86832024-09-09T17:59:23.803ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:1853 instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 760054d9-c981-48b3-88ba-f2e26d33bb6c vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-09-09T17:59:07.562006285Z }
86842024-09-09T17:59:23.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 roles = RoleSet { roles: {} }
86852024-09-09T17:59:23.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 resource = Database result = Ok(())
86862024-09-09T17:59:23.831ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86872024-09-09T17:59:23.832ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "61fad09b-4e5b-413b-8771-6c07d89dde3d", "content-length": "523", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} })
86882024-09-09T17:59:23.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86892024-09-09T17:59:23.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86902024-09-09T17:59:23.834ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86912024-09-09T17:59:23.837ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
86922024-09-09T17:59:23.837ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86932024-09-09T17:59:23.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86942024-09-09T17:59:23.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86952024-09-09T17:59:23.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86962024-09-09T17:59:23.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86972024-09-09T17:59:23.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86982024-09-09T17:59:23.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86992024-09-09T17:59:23.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
87002024-09-09T17:59:23.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87012024-09-09T17:59:23.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87022024-09-09T17:59:23.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87032024-09-09T17:59:23.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87042024-09-09T17:59:23.853ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 414.381138ms iteration = 15 status = 0
87052024-09-09T17:59:23.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87062024-09-09T17:59:23.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87072024-09-09T17:59:23.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87082024-09-09T17:59:23.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87092024-09-09T17:59:23.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87102024-09-09T17:59:23.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87112024-09-09T17:59:23.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87122024-09-09T17:59:23.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87132024-09-09T17:59:23.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87142024-09-09T17:59:23.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87152024-09-09T17:59:23.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87162024-09-09T17:59:23.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87172024-09-09T17:59:23.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87182024-09-09T17:59:23.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87192024-09-09T17:59:23.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87202024-09-09T17:59:23.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87212024-09-09T17:59:23.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 442.311132ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
87222024-09-09T17:59:23.888ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
87232024-09-09T17:59:23.888ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 448.749109ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
87242024-09-09T17:59:23.890ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87252024-09-09T17:59:23.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
87262024-09-09T17:59:23.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87272024-09-09T17:59:23.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87282024-09-09T17:59:23.896ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-09T17:52:21.456201Z, time_modified: 2024-09-09T17:52:21.456201Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
87292024-09-09T17:59:23.896ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 458.220315ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]}},"default_endpoint":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
87302024-09-09T17:59:23.896ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
87312024-09-09T17:59:23.896ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
87322024-09-09T17:59:23.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87332024-09-09T17:59:23.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87342024-09-09T17:59:23.901ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 463.052623ms iteration = 15 status = {}
87352024-09-09T17:59:23.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87362024-09-09T17:59:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87372024-09-09T17:59:23.906ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87382024-09-09T17:59:23.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87392024-09-09T17:59:23.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87402024-09-09T17:59:23.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87412024-09-09T17:59:23.909ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87422024-09-09T17:59:23.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87432024-09-09T17:59:23.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87442024-09-09T17:59:23.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87452024-09-09T17:59:23.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87462024-09-09T17:59:23.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87472024-09-09T17:59:23.913ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87482024-09-09T17:59:23.913ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87492024-09-09T17:59:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87502024-09-09T17:59:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 7f64605e-b035-408a-9a6a-d8f7d5f3252b, lookup_type: ById(7f64605e-b035-408a-9a6a-d8f7d5f3252b) }, key: 4358649a-87d3-4a30-83f8-7a67537edd0f, lookup_type: ById(4358649a-87d3-4a30-83f8-7a67537edd0f) }, key: 652dd39d-6c72-4608-b6dd-ded5c4d7940a, lookup_type: ById(652dd39d-6c72-4608-b6dd-ded5c4d7940a) } result = Ok(())
87512024-09-09T17:59:23.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87522024-09-09T17:59:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87532024-09-09T17:59:23.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87542024-09-09T17:59:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87552024-09-09T17:59:23.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87562024-09-09T17:59:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87572024-09-09T17:59:23.931ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
87582024-09-09T17:59:23.931ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f85bc79a-979c-4718-884b-92d3e7e8ef5b", "content-length": "1", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} })
87592024-09-09T17:59:23.933ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87602024-09-09T17:59:23.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87612024-09-09T17:59:23.937ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87622024-09-09T17:59:23.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
87632024-09-09T17:59:23.940ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87642024-09-09T17:59:23.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87652024-09-09T17:59:23.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = ff8e8f3a-e878-45b1-b049-74b504c357d4 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
87662024-09-09T17:59:23.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = ff8e8f3a-e878-45b1-b049-74b504c357d4 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
87672024-09-09T17:59:24.001ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
87682024-09-09T17:59:24.001ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "875003b3-6579-47c3-87b9-51b9f9f88936", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87692024-09-09T17:59:24.001ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87702024-09-09T17:59:24.003ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "154a1f34-6f31-457d-afc1-3bf7f6076e49", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87712024-09-09T17:59:24.003ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87722024-09-09T17:59:24.006ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87732024-09-09T17:59:24.006ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 568.20983ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
87742024-09-09T17:59:24.032ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
87752024-09-09T17:59:24.042ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
87762024-09-09T17:59:24.043ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "81ada18c-c657-4cc1-9ac5-4dc5b987faed", "content-length": "810", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} })
87772024-09-09T17:59:24.043ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 254, 208, 226])), vni: Vni(6460566) }} sled = buskin
87782024-09-09T17:59:24.043ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
87792024-09-09T17:59:24.043ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
87802024-09-09T17:59:24.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87812024-09-09T17:59:24.045ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 606.195202ms iteration = 15 status = {}
87822024-09-09T17:59:24.045ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 607.397659ms iteration = 15 status = null
87832024-09-09T17:59:24.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 7f64605e-b035-408a-9a6a-d8f7d5f3252b, lookup_type: ById(7f64605e-b035-408a-9a6a-d8f7d5f3252b) }, key: 4358649a-87d3-4a30-83f8-7a67537edd0f, lookup_type: ById(4358649a-87d3-4a30-83f8-7a67537edd0f) }, key: 652dd39d-6c72-4608-b6dd-ded5c4d7940a, lookup_type: ById(652dd39d-6c72-4608-b6dd-ded5c4d7940a) } result = Ok(())
87842024-09-09T17:59:24.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87852024-09-09T17:59:24.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87862024-09-09T17:59:24.050ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
87872024-09-09T17:59:24.050ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
87882024-09-09T17:59:24.050ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-09 17:52:53.875764 UTC dns_group = internal generation = 1
87892024-09-09T17:59:24.050ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 611.477512ms iteration = 9 status = {"generation":1}
87902024-09-09T17:59:24.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = ff8e8f3a-e878-45b1-b049-74b504c357d4 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
87912024-09-09T17:59:24.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87922024-09-09T17:59:24.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87932024-09-09T17:59:24.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87942024-09-09T17:59:24.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87952024-09-09T17:59:24.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87962024-09-09T17:59:24.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87972024-09-09T17:59:24.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87982024-09-09T17:59:24.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87992024-09-09T17:59:24.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88002024-09-09T17:59:24.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88012024-09-09T17:59:24.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88022024-09-09T17:59:24.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88032024-09-09T17:59:24.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88042024-09-09T17:59:24.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88052024-09-09T17:59:24.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88062024-09-09T17:59:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 7f64605e-b035-408a-9a6a-d8f7d5f3252b, lookup_type: ById(7f64605e-b035-408a-9a6a-d8f7d5f3252b) }, key: 4358649a-87d3-4a30-83f8-7a67537edd0f, lookup_type: ById(4358649a-87d3-4a30-83f8-7a67537edd0f) }, key: d1f22a21-a2f1-4523-87c6-494e5c083d25, lookup_type: ByName("default") } result = Ok(())
88072024-09-09T17:59:24.067ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88082024-09-09T17:59:24.078ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88092024-09-09T17:59:24.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88102024-09-09T17:59:24.080ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 8ddbbc53-8b49-46f3-8c46-10ed4300f6d2, rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e) } rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
88112024-09-09T17:59:24.080ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88122024-09-09T17:59:24.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88132024-09-09T17:59:24.090ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
88142024-09-09T17:59:24.090ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
88152024-09-09T17:59:24.091ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2d863f78-6bec-4948-9962-2e73ca4d03a1", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
88162024-09-09T17:59:24.091ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
88172024-09-09T17:59:24.092ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3aa700ab-4894-43a8-8e7e-41963e01e571", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
88182024-09-09T17:59:24.092ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d66157ae-42b1-4a7f-9349-8db1c4522eb3", "content-length": "121", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} })
88192024-09-09T17:59:24.092ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
88202024-09-09T17:59:24.092ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
88212024-09-09T17:59:24.092ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e
88222024-09-09T17:59:24.092ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
88232024-09-09T17:59:24.092ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
88242024-09-09T17:59:24.092ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
88252024-09-09T17:59:24.093ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
88262024-09-09T17:59:24.093ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
88272024-09-09T17:59:24.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88282024-09-09T17:59:24.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88292024-09-09T17:59:24.094ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6a35ae1b-9d98-4f4d-84cb-00664f72bb1c", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
88302024-09-09T17:59:24.094ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
88312024-09-09T17:59:24.095ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
88322024-09-09T17:59:24.096ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
88332024-09-09T17:59:24.096ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 657.768964ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
88342024-09-09T17:59:24.096ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "867f3818-3cae-4831-8b5a-aa9904ddb5ca", "content-length": "2", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} })
88352024-09-09T17:59:24.096ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
88362024-09-09T17:59:24.096ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "717536ca-2535-42d3-933f-1d8b27bed29d", "content-length": "51", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} })
88372024-09-09T17:59:24.096ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
88382024-09-09T17:59:24.096ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
88392024-09-09T17:59:24.151ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f9d23242-16d7-42f4-a92e-8acd7481057f", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} })
88402024-09-09T17:59:24.152ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 713.548111ms iteration = 16 status = {}
88412024-09-09T17:59:24.248ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "23f8c2d1-2e3b-48e0-a7d1-c704c5ecd53b", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} })
88422024-09-09T17:59:24.248ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch = Switch0
88432024-09-09T17:59:24.248ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
88442024-09-09T17:59:24.248ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b54662b2-a348-4847-8793-65ec9a62933e", "content-length": "667", "date": "Mon, 09 Sep 2024 17:59:23 GMT"} })
88452024-09-09T17:59:24.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88462024-09-09T17:59:24.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88472024-09-09T17:59:24.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88482024-09-09T17:59:24.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88492024-09-09T17:59:24.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88502024-09-09T17:59:24.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88512024-09-09T17:59:24.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88522024-09-09T17:59:24.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88532024-09-09T17:59:24.264ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 825.407706ms iteration = 15 status = {}
88542024-09-09T17:59:25.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 91c8eff2-c4d4-4919-9a0e-b138217a078d roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88552024-09-09T17:59:25.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 91c8eff2-c4d4-4919-9a0e-b138217a078d resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88562024-09-09T17:59:25.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 91c8eff2-c4d4-4919-9a0e-b138217a078d response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88572024-09-09T17:59:25.689ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4301 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = ffeb839a-1325-44a4-8208-dca6851f74ee response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
88582024-09-09T17:59:26.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 8705f366-8f6a-48d1-9ed1-da043e0f69c6 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88592024-09-09T17:59:26.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 8705f366-8f6a-48d1-9ed1-da043e0f69c6 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88602024-09-09T17:59:26.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 8705f366-8f6a-48d1-9ed1-da043e0f69c6 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88612024-09-09T17:59:27.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 32a17306-b18f-46c8-938c-6b23df514776 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88622024-09-09T17:59:27.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 32a17306-b18f-46c8-938c-6b23df514776 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88632024-09-09T17:59:27.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 32a17306-b18f-46c8-938c-6b23df514776 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88642024-09-09T17:59:28.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = c936bbda-52fb-40b1-95f1-788020833bb3 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88652024-09-09T17:59:28.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = c936bbda-52fb-40b1-95f1-788020833bb3 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88662024-09-09T17:59:28.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = c936bbda-52fb-40b1-95f1-788020833bb3 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88672024-09-09T17:59:29.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 044d848f-35af-40ec-a82c-27c60c14eb54 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88682024-09-09T17:59:29.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 044d848f-35af-40ec-a82c-27c60c14eb54 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88692024-09-09T17:59:29.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 044d848f-35af-40ec-a82c-27c60c14eb54 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88702024-09-09T17:59:30.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = d6ac8250-137b-4024-919b-7a6ac2cd1dd0 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88712024-09-09T17:59:30.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = d6ac8250-137b-4024-919b-7a6ac2cd1dd0 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88722024-09-09T17:59:30.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = d6ac8250-137b-4024-919b-7a6ac2cd1dd0 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88732024-09-09T17:59:31.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1562745b-d232-493c-8ed8-60710d27cf13 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88742024-09-09T17:59:31.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1562745b-d232-493c-8ed8-60710d27cf13 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88752024-09-09T17:59:31.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1562745b-d232-493c-8ed8-60710d27cf13 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88762024-09-09T17:59:32.112ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 760054d9-c981-48b3-88ba-f2e26d33bb6c remote_addr = [fd00:1122:3344:101::1]:44885 req_id = c66ea1ff-633e-4615-955d-c22e80c50c05 uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-09-09T17:59:32.111713153Z }
88772024-09-09T17:59:32.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = c66ea1ff-633e-4615-955d-c22e80c50c05 roles = RoleSet { roles: {} } uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
88782024-09-09T17:59:32.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = c66ea1ff-633e-4615-955d-c22e80c50c05 resource = Database result = Ok(()) uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
88792024-09-09T17:59:32.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 45806 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = c66ea1ff-633e-4615-955d-c22e80c50c05 response_code = 204 uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
88802024-09-09T17:59:32.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 28b77741-1728-47b7-85e0-6cb3589fc380 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88812024-09-09T17:59:32.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 28b77741-1728-47b7-85e0-6cb3589fc380 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88822024-09-09T17:59:32.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 28b77741-1728-47b7-85e0-6cb3589fc380 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88832024-09-09T17:59:33.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 29e30e4c-61e5-4a60-ba60-1e3c07904e68 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88842024-09-09T17:59:33.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 29e30e4c-61e5-4a60-ba60-1e3c07904e68 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88852024-09-09T17:59:33.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 29e30e4c-61e5-4a60-ba60-1e3c07904e68 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
88862024-09-09T17:59:33.439ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
88872024-09-09T17:59:33.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88882024-09-09T17:59:33.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88892024-09-09T17:59:33.439ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
88902024-09-09T17:59:33.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88912024-09-09T17:59:33.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88922024-09-09T17:59:33.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88932024-09-09T17:59:33.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88942024-09-09T17:59:33.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88952024-09-09T17:59:33.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88962024-09-09T17:59:33.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88972024-09-09T17:59:33.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88982024-09-09T17:59:33.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88992024-09-09T17:59:33.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
89002024-09-09T17:59:33.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89012024-09-09T17:59:33.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89022024-09-09T17:59:33.456ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
89032024-09-09T17:59:33.456ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.376902ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
89042024-09-09T17:59:33.466ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89052024-09-09T17:59:33.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89062024-09-09T17:59:33.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.133808ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89072024-09-09T17:59:34.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 05414fe2-33ef-46e8-ab5d-a9a293aee00d roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
89082024-09-09T17:59:34.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 05414fe2-33ef-46e8-ab5d-a9a293aee00d resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
89092024-09-09T17:59:34.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 05414fe2-33ef-46e8-ab5d-a9a293aee00d response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
89102024-09-09T17:59:34.571ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 760054d9-c981-48b3-88ba-f2e26d33bb6c remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-09-09T17:59:34.570863819Z }
89112024-09-09T17:59:34.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf roles = RoleSet { roles: {} } uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89122024-09-09T17:59:34.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf resource = Database result = Ok(()) uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89132024-09-09T17:59:34.583ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 760054d9-c981-48b3-88ba-f2e26d33bb6c remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c vmm_needs_update = true
89142024-09-09T17:59:34.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf roles = RoleSet { roles: {} } uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89152024-09-09T17:59:34.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf resource = Database result = Ok(()) uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89162024-09-09T17:59:34.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf roles = RoleSet { roles: {} } uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89172024-09-09T17:59:34.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf resource = Database result = Ok(()) uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89182024-09-09T17:59:34.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf roles = RoleSet { roles: {} } uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89192024-09-09T17:59:34.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf resource = Database result = Ok(()) uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89202024-09-09T17:59:34.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf roles = RoleSet { roles: {} } uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89212024-09-09T17:59:34.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf resource = Database result = Ok(()) uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89222024-09-09T17:59:34.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf roles = RoleSet { roles: {} } uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89232024-09-09T17:59:34.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf resource = Database result = Ok(()) uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89242024-09-09T17:59:34.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf roles = RoleSet { roles: {} } uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89252024-09-09T17:59:34.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf resource = Database result = Ok(()) uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89262024-09-09T17:59:34.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89272024-09-09T17:59:34.600ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 7f64605e-b035-408a-9a6a-d8f7d5f3252b, lookup_type: ById(7f64605e-b035-408a-9a6a-d8f7d5f3252b) }, key: 9a69ee61-cd07-4e16-8bce-71a799ee7a11, lookup_type: ById(9a69ee61-cd07-4e16-8bce-71a799ee7a11) } result = Ok(()) uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89282024-09-09T17:59:34.600ZINFOnexus (dropshot_internal): starting update saga for 9a69ee61-cd07-4e16-8bce-71a799ee7a11 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1349 instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-09-09T17:59:34.570863819Z }
89292024-09-09T17:59:34.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 29542 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bc5a4bc1-3d8e-40de-a36a-61ab9ff1b0bf response_code = 204 uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89302024-09-09T17:59:34.601ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 760054d9-c981-48b3-88ba-f2e26d33bb6c remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 0a84b70a-db1a-43a9-abf9-8faf0d4bd994 uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-09-09T17:59:34.570863819Z }
89312024-09-09T17:59:34.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 0a84b70a-db1a-43a9-abf9-8faf0d4bd994 roles = RoleSet { roles: {} } uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89322024-09-09T17:59:34.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 0a84b70a-db1a-43a9-abf9-8faf0d4bd994 resource = Database result = Ok(()) uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89332024-09-09T17:59:34.603ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update
89342024-09-09T17:59:34.603ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"9a69ee61-cd07-4e16-8bce-71a799ee7a11","lookup_type":{"ById":"9a69ee61-cd07-4e16-8bce-71a799ee7a11"},"parent":{"key":"7f64605e-b035-408a-9a6a-d8f7d5f3252b","lookup_type":{"ById":"7f64605e-b035-408a-9a6a-d8f7d5f3252b"},"parent":{"key":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","lookup_type":{"ById":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
89352024-09-09T17:59:34.603ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update
89362024-09-09T17:59:34.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 30721 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 0a84b70a-db1a-43a9-abf9-8faf0d4bd994 response_code = 204 uri = /vmms/760054d9-c981-48b3-88ba-f2e26d33bb6c
89372024-09-09T17:59:34.638ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update
89382024-09-09T17:59:34.638ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
89392024-09-09T17:59:34.638ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
89402024-09-09T17:59:34.638ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2
89412024-09-09T17:59:34.645ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
89422024-09-09T17:59:34.645ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2
89432024-09-09T17:59:34.650ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
89442024-09-09T17:59:34.650ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2
89452024-09-09T17:59:34.654ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
89462024-09-09T17:59:34.654ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("e454d9a8-bb70-418a-91d8-46bc8b7c6423")) node_id = 0 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2
89472024-09-09T17:59:34.659ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
89482024-09-09T17:59:34.659ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2
89492024-09-09T17:59:34.663ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update
89502024-09-09T17:59:34.663ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89512024-09-09T17:59:34.663ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89522024-09-09T17:59:34.665ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89532024-09-09T17:59:34.665ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89542024-09-09T17:59:34.666ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89552024-09-09T17:59:34.667ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89562024-09-09T17:59:34.668ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89572024-09-09T17:59:34.668ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89582024-09-09T17:59:34.669ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89592024-09-09T17:59:34.670ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89602024-09-09T17:59:34.671ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89612024-09-09T17:59:34.671ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89622024-09-09T17:59:34.672ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89632024-09-09T17:59:34.675ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 7f64605e-b035-408a-9a6a-d8f7d5f3252b, lookup_type: ById(7f64605e-b035-408a-9a6a-d8f7d5f3252b) }, key: 9a69ee61-cd07-4e16-8bce-71a799ee7a11, lookup_type: ById(9a69ee61-cd07-4e16-8bce-71a799ee7a11) } result = Ok(()) saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89642024-09-09T17:59:34.675ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance updater_id = e454d9a8-bb70-418a-91d8-46bc8b7c6423
89652024-09-09T17:59:34.675ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89662024-09-09T17:59:34.675ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89672024-09-09T17:59:34.688ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance updater_id = e454d9a8-bb70-418a-91d8-46bc8b7c6423
89682024-09-09T17:59:34.688ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89692024-09-09T17:59:34.688ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance
89702024-09-09T17:59:34.691ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 locked_gen = Generation(Generation(2)) saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = LockInstance updater_id = e454d9a8-bb70-418a-91d8-46bc8b7c6423
89712024-09-09T17:59:34.691ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
89722024-09-09T17:59:34.691ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("e454d9a8-bb70-418a-91d8-46bc8b7c6423")}) node_id = 1 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2
89732024-09-09T17:59:34.697ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
89742024-09-09T17:59:34.697ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2
89752024-09-09T17:59:34.706ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89762024-09-09T17:59:34.706ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89772024-09-09T17:59:34.708ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89782024-09-09T17:59:34.708ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89792024-09-09T17:59:34.709ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89802024-09-09T17:59:34.709ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89812024-09-09T17:59:34.710ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89822024-09-09T17:59:34.713ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 7f64605e-b035-408a-9a6a-d8f7d5f3252b, lookup_type: ById(7f64605e-b035-408a-9a6a-d8f7d5f3252b) }, key: 9a69ee61-cd07-4e16-8bce-71a799ee7a11, lookup_type: ById(9a69ee61-cd07-4e16-8bce-71a799ee7a11) } result = Ok(()) saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89832024-09-09T17:59:34.713ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89842024-09-09T17:59:34.713ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
89852024-09-09T17:59:34.723ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 760054d9-c981-48b3-88ba-f2e26d33bb6c, time_created: 2024-09-09T17:58:58.496726Z, time_deleted: None, instance_id: 9a69ee61-cd07-4e16-8bce-71a799ee7a11, sled_id: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-09-09T17:59:34.570863Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-09-09T17:58:58.539917Z, gen: Generation(Generation(3)), propolis_id: Some(760054d9-c981-48b3-88ba-f2e26d33bb6c), dst_propolis_id: None, migration_id: None, nexus_state: Vmm } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(760054d9-c981-48b3-88ba-f2e26d33bb6c (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-09-09T17:59:34.723324323Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm }
89862024-09-09T17:59:34.723ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update
89872024-09-09T17:59:34.723ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"9a69ee61-cd07-4e16-8bce-71a799ee7a11","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"760054d9-c981-48b3-88ba-f2e26d33bb6c"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Start":{"params":{"authz_instance":{"key":"9a69ee61-cd07-4e16-8bce-71a799ee7a11","lookup_type":{"ById":"9a69ee61-cd07-4e16-8bce-71a799ee7a11"},"parent":{"key":"7f64605e-b035-408a-9a6a-d8f7d5f3252b","lookup_type":{"ById":"7f64605e-b035-408a-9a6a-d8f7d5f3252b"},"parent":{"key":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","lookup_type":{"ById":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"e454d9a8-bb70-418a-91d8-46bc8b7c6423"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"7f64605e-b035-408a-9a6a-d8f7d5f3252b","ram_diff":1073741824},"destroy_active_vmm":"760054d9-c981-48b3-88ba-f2e26d33bb6c","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_updated":"2024-09-09T17:59:34.723324323Z"}}}}},"End"]},"saga_name":"instance-update","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
89882024-09-09T17:59:34.723ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update
89892024-09-09T17:59:34.729ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update
89902024-09-09T17:59:34.729ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
89912024-09-09T17:59:34.729ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
89922024-09-09T17:59:34.729ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
89932024-09-09T17:59:34.733ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
89942024-09-09T17:59:34.733ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
89952024-09-09T17:59:34.738ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
89962024-09-09T17:59:34.738ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
89972024-09-09T17:59:34.743ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
89982024-09-09T17:59:34.743ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("56a3a075-44e4-491d-bd64-f4fabf82d165")) node_id = 0 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
89992024-09-09T17:59:34.748ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
90002024-09-09T17:59:34.748ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
90012024-09-09T17:59:34.753ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 parent_lock = UpdaterLock { updater_id: e454d9a8-bb70-418a-91d8-46bc8b7c6423, locked_gen: Generation(Generation(2)) } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update
90022024-09-09T17:59:34.753ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = BecomeUpdater
90032024-09-09T17:59:34.753ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = BecomeUpdater
90042024-09-09T17:59:34.763ZDEBGnexus (SagaExecutor): inherited lock from e454d9a8-bb70-418a-91d8-46bc8b7c6423 to 56a3a075-44e4-491d-bd64-f4fabf82d165 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = e454d9a8-bb70-418a-91d8-46bc8b7c6423 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = BecomeUpdater updater_id = 56a3a075-44e4-491d-bd64-f4fabf82d165
90052024-09-09T17:59:34.765ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:932 instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update
90062024-09-09T17:59:34.765ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
90072024-09-09T17:59:34.765ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("56a3a075-44e4-491d-bd64-f4fabf82d165")}) node_id = 1 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
90082024-09-09T17:59:34.769ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
90092024-09-09T17:59:34.769ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
90102024-09-09T17:59:34.775ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
90112024-09-09T17:59:34.775ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
90122024-09-09T17:59:34.779ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
90132024-09-09T17:59:34.779ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
90142024-09-09T17:59:34.785ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:985 instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update
90152024-09-09T17:59:34.789ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11
90162024-09-09T17:59:34.792ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = UpdateNetworkConfig
90172024-09-09T17:59:34.792ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = UpdateNetworkConfig
90182024-09-09T17:59:34.794ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = UpdateNetworkConfig
90192024-09-09T17:59:34.795ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = UpdateNetworkConfig
90202024-09-09T17:59:34.799ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
90212024-09-09T17:59:34.799ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = UpdateNetworkConfig
90222024-09-09T17:59:34.799ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = UpdateNetworkConfig
90232024-09-09T17:59:34.801ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
90242024-09-09T17:59:34.801ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
90252024-09-09T17:59:34.802ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
90262024-09-09T17:59:34.803ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
90272024-09-09T17:59:34.804ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
90282024-09-09T17:59:34.804ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
90292024-09-09T17:59:34.804ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
90302024-09-09T17:59:34.811ZDEBGnexus: notifying dendrite of updates instance_id = Some(9a69ee61-cd07-4e16-8bce-71a799ee7a11 (instance)) switch = switch0
90312024-09-09T17:59:34.811ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 34096, tv_nsec: 407482169 } })
90322024-09-09T17:59:34.811ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
90332024-09-09T17:59:34.842ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
90342024-09-09T17:59:34.842ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90352024-09-09T17:59:34.843ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "63f266f1-7f9a-4277-8941-89864e64d847", "content-length": "26", "date": "Mon, 09 Sep 2024 17:59:34 GMT"} })
90362024-09-09T17:59:34.843ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90372024-09-09T17:59:34.844ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90382024-09-09T17:59:34.873ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
90392024-09-09T17:59:34.874ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "912c89ee-830a-4451-8a11-fbe193c79ca9", "content-length": "4", "date": "Mon, 09 Sep 2024 17:59:34 GMT"} })
90402024-09-09T17:59:34.876ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
90412024-09-09T17:59:34.876ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
90422024-09-09T17:59:34.884ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
90432024-09-09T17:59:34.884ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
90442024-09-09T17:59:34.887ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
90452024-09-09T17:59:34.888ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
90462024-09-09T17:59:34.906ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1060 instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-09-09T17:59:34.890651Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 7f64605e-b035-408a-9a6a-d8f7d5f3252b, time_modified: Some(2024-09-09T17:59:34.890651Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, time_modified: Some(2024-09-09T17:59:34.890651Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update
90472024-09-09T17:59:34.906ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
90482024-09-09T17:59:34.906ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
90492024-09-09T17:59:34.913ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
90502024-09-09T17:59:34.913ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
90512024-09-09T17:59:34.933ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1095 instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update
90522024-09-09T17:59:34.933ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = UnassignOximeterProducer
90532024-09-09T17:59:34.933ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = UnassignOximeterProducer
90542024-09-09T17:59:34.941ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 producer_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update
90552024-09-09T17:59:34.941ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = UnassignOximeterProducer
90562024-09-09T17:59:34.941ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = UnassignOximeterProducer
90572024-09-09T17:59:34.976ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update
90582024-09-09T17:59:34.976ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/9a69ee61-cd07-4e16-8bce-71a799ee7a11
90592024-09-09T17:59:34.977ZDEBGnexus (SagaExecutor): client response oximeter-collector = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers/9a69ee61-cd07-4e16-8bce-71a799ee7a11", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ec06ffeb-7d7f-4c87-9028-4840eafdb418", "date": "Mon, 09 Sep 2024 17:59:34 GMT"} }) saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update
90602024-09-09T17:59:34.977ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 producer_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update
90612024-09-09T17:59:34.979ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
90622024-09-09T17:59:34.979ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
90632024-09-09T17:59:34.984ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
90642024-09-09T17:59:34.984ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
90652024-09-09T17:59:34.994ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 lock = UpdaterLock { updater_id: 56a3a075-44e4-491d-bd64-f4fabf82d165, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-09-09T17:59:34.723324323Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update
90662024-09-09T17:59:34.994ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = CommitInstanceUpdates
90672024-09-09T17:59:34.994ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = CommitInstanceUpdates
90682024-09-09T17:59:35.033ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1144 instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 new_runtime = InstanceRuntimeState { time_updated: 2024-09-09T17:59:34.723324323Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update
90692024-09-09T17:59:35.033ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = CommitInstanceUpdates
90702024-09-09T17:59:35.033ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Signaled
90712024-09-09T17:59:35.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90722024-09-09T17:59:35.033ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = CommitInstanceUpdates
90732024-09-09T17:59:35.033ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Signaled
90742024-09-09T17:59:35.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90752024-09-09T17:59:35.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90762024-09-09T17:59:35.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90772024-09-09T17:59:35.035ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = CommitInstanceUpdates
90782024-09-09T17:59:35.035ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = CommitInstanceUpdates
90792024-09-09T17:59:35.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90802024-09-09T17:59:35.036ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = CommitInstanceUpdates
90812024-09-09T17:59:35.037ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = CommitInstanceUpdates
90822024-09-09T17:59:35.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90832024-09-09T17:59:35.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90842024-09-09T17:59:35.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90852024-09-09T17:59:35.038ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = CommitInstanceUpdates
90862024-09-09T17:59:35.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90872024-09-09T17:59:35.041ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90882024-09-09T17:59:35.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90892024-09-09T17:59:35.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90902024-09-09T17:59:35.041ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, lookup_type: ById(8dd86d6f-ad2d-45da-852c-8351c18c2cc5) }, key: 7f64605e-b035-408a-9a6a-d8f7d5f3252b, lookup_type: ById(7f64605e-b035-408a-9a6a-d8f7d5f3252b) }, key: 9a69ee61-cd07-4e16-8bce-71a799ee7a11, lookup_type: ById(9a69ee61-cd07-4e16-8bce-71a799ee7a11) } result = Ok(()) saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = CommitInstanceUpdates
90912024-09-09T17:59:35.041ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = CommitInstanceUpdates
90922024-09-09T17:59:35.041ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = CommitInstanceUpdates
90932024-09-09T17:59:35.045ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
90942024-09-09T17:59:35.046ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
90952024-09-09T17:59:35.053ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
90962024-09-09T17:59:35.053ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
90972024-09-09T17:59:35.060ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
90982024-09-09T17:59:35.060ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("9a69ee61-cd07-4e16-8bce-71a799ee7a11"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("760054d9-c981-48b3-88ba-f2e26d33bb6c")}) node_id = 7 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
90992024-09-09T17:59:35.069ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91002024-09-09T17:59:35.069ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
91012024-09-09T17:59:35.077ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91022024-09-09T17:59:35.077ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
91032024-09-09T17:59:35.083ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91042024-09-09T17:59:35.083ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
91052024-09-09T17:59:35.089ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 propolis_id = 760054d9-c981-48b3-88ba-f2e26d33bb6c saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update
91062024-09-09T17:59:35.089ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = ReleaseSledResources
91072024-09-09T17:59:35.089ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = ReleaseSledResources
91082024-09-09T17:59:35.108ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91092024-09-09T17:59:35.108ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
91102024-09-09T17:59:35.117ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91112024-09-09T17:59:35.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91122024-09-09T17:59:35.121ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91132024-09-09T17:59:35.122ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9524703b-75c3-421f-9a7d-55816ffd5f49", "content-length": "372", "date": "Mon, 09 Sep 2024 17:59:35 GMT"} })
91142024-09-09T17:59:35.122ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91152024-09-09T17:59:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91162024-09-09T17:59:35.124ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91172024-09-09T17:59:35.124ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91182024-09-09T17:59:35.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91192024-09-09T17:59:35.125ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
91202024-09-09T17:59:35.127ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91212024-09-09T17:59:35.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91222024-09-09T17:59:35.130ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91232024-09-09T17:59:35.130ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "40c3d96d-a1a7-42f5-877a-9bad820f7720", "date": "Mon, 09 Sep 2024 17:59:35 GMT"} })
91242024-09-09T17:59:35.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91252024-09-09T17:59:35.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91262024-09-09T17:59:35.131ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 propolis_id = 760054d9-c981-48b3-88ba-f2e26d33bb6c saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update
91272024-09-09T17:59:35.131ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = MarkVmmDeleted
91282024-09-09T17:59:35.131ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_node = MarkVmmDeleted
91292024-09-09T17:59:35.132ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 98.651088ms iteration = 17 status = {}
91302024-09-09T17:59:35.158ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91312024-09-09T17:59:35.160ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91322024-09-09T17:59:35.160ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91332024-09-09T17:59:35.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91342024-09-09T17:59:35.162ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91352024-09-09T17:59:35.164ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91362024-09-09T17:59:35.164ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91372024-09-09T17:59:35.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91382024-09-09T17:59:35.174ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91392024-09-09T17:59:35.174ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
91402024-09-09T17:59:35.177ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91412024-09-09T17:59:35.177ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
91422024-09-09T17:59:35.184ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91432024-09-09T17:59:35.184ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
91442024-09-09T17:59:35.189ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91452024-09-09T17:59:35.189ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
91462024-09-09T17:59:35.195ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91472024-09-09T17:59:35.195ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
91482024-09-09T17:59:35.199ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91492024-09-09T17:59:35.199ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15
91502024-09-09T17:59:35.238ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91512024-09-09T17:59:35.238ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 saga_name = instance-update saga_result = SagaResult { saga_id: bc57ba01-c721-4426-a1a4-63b0873d7f15, saga_log: SagaLog { saga_id: bc57ba01-c721-4426-a1a4-63b0873d7f15, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(String("56a3a075-44e4-491d-bd64-f4fabf82d165")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("56a3a075-44e4-491d-bd64-f4fabf82d165")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("9a69ee61-cd07-4e16-8bce-71a799ee7a11"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("760054d9-c981-48b3-88ba-f2e26d33bb6c")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("9a69ee61-cd07-4e16-8bce-71a799ee7a11"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("760054d9-c981-48b3-88ba-f2e26d33bb6c")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("56a3a075-44e4-491d-bd64-f4fabf82d165"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("56a3a075-44e4-491d-bd64-f4fabf82d165")}} }) }
91522024-09-09T17:59:35.238ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = bc57ba01-c721-4426-a1a4-63b0873d7f15 instance_id = 9a69ee61-cd07-4e16-8bce-71a799ee7a11 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update
91532024-09-09T17:59:35.238ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91542024-09-09T17:59:35.238ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2
91552024-09-09T17:59:35.245ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91562024-09-09T17:59:35.245ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2
91572024-09-09T17:59:35.250ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
91582024-09-09T17:59:35.250ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "734f852e-67fc-4283-bd9a-87b617107673", "content-length": "691", "date": "Mon, 09 Sep 2024 17:59:35 GMT"} })
91592024-09-09T17:59:35.250ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
91602024-09-09T17:59:35.250ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
91612024-09-09T17:59:35.250ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
91622024-09-09T17:59:35.251ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91632024-09-09T17:59:35.251ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2
91642024-09-09T17:59:35.252ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 219.445285ms iteration = 16 status = {}
91652024-09-09T17:59:35.256ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91662024-09-09T17:59:35.256ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2
91672024-09-09T17:59:35.291ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update sec_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91682024-09-09T17:59:35.291ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = e1911d25-fe9e-4235-9261-10b89d23a4d2 saga_name = start-instance-update saga_result = SagaResult { saga_id: e1911d25-fe9e-4235-9261-10b89d23a4d2, saga_log: SagaLog { saga_id: e1911d25-fe9e-4235-9261-10b89d23a4d2, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("e454d9a8-bb70-418a-91d8-46bc8b7c6423")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("e454d9a8-bb70-418a-91d8-46bc8b7c6423")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("e454d9a8-bb70-418a-91d8-46bc8b7c6423"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("e454d9a8-bb70-418a-91d8-46bc8b7c6423")}} }) }
91692024-09-09T17:59:35.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 068a9c5f-fd87-4472-8cbb-9bb78ed185bc roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91702024-09-09T17:59:35.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 068a9c5f-fd87-4472-8cbb-9bb78ed185bc resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91712024-09-09T17:59:35.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 068a9c5f-fd87-4472-8cbb-9bb78ed185bc response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91722024-09-09T17:59:35.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1286 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 06e8e6b1-43ec-4234-9e05-2e9066409727 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
91732024-09-09T17:59:36.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 8f825524-dca0-4555-b8ff-a48d45dcdf47 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91742024-09-09T17:59:36.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 8f825524-dca0-4555-b8ff-a48d45dcdf47 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91752024-09-09T17:59:36.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 8f825524-dca0-4555-b8ff-a48d45dcdf47 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91762024-09-09T17:59:37.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = a1aebf24-9683-44ac-ac7c-9da5e9aa48b9 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91772024-09-09T17:59:37.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = a1aebf24-9683-44ac-ac7c-9da5e9aa48b9 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91782024-09-09T17:59:37.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = a1aebf24-9683-44ac-ac7c-9da5e9aa48b9 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91792024-09-09T17:59:38.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 64a9ab5e-c0e9-4116-80ae-e49a53e8e244 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91802024-09-09T17:59:38.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 64a9ab5e-c0e9-4116-80ae-e49a53e8e244 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91812024-09-09T17:59:38.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 64a9ab5e-c0e9-4116-80ae-e49a53e8e244 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91822024-09-09T17:59:39.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b3d9f052-da9a-48b8-8da9-fed2dc0c4863 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91832024-09-09T17:59:39.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b3d9f052-da9a-48b8-8da9-fed2dc0c4863 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91842024-09-09T17:59:39.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b3d9f052-da9a-48b8-8da9-fed2dc0c4863 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91852024-09-09T17:59:40.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3747e298-e37d-4f2a-b39b-1bc4aad914a5 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91862024-09-09T17:59:40.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3747e298-e37d-4f2a-b39b-1bc4aad914a5 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91872024-09-09T17:59:40.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3747e298-e37d-4f2a-b39b-1bc4aad914a5 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91882024-09-09T17:59:41.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = fff3109b-815d-470e-85da-b738b3898d60 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91892024-09-09T17:59:41.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = fff3109b-815d-470e-85da-b738b3898d60 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91902024-09-09T17:59:41.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = fff3109b-815d-470e-85da-b738b3898d60 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91912024-09-09T17:59:42.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 33496898-a324-40e7-af3d-64931ea9b8a3 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91922024-09-09T17:59:42.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 33496898-a324-40e7-af3d-64931ea9b8a3 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91932024-09-09T17:59:42.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 33496898-a324-40e7-af3d-64931ea9b8a3 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
91942024-09-09T17:59:43.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
91952024-09-09T17:59:43.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91962024-09-09T17:59:43.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91972024-09-09T17:59:43.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
91982024-09-09T17:59:43.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91992024-09-09T17:59:43.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92002024-09-09T17:59:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92012024-09-09T17:59:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92022024-09-09T17:59:43.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92032024-09-09T17:59:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92042024-09-09T17:59:43.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92052024-09-09T17:59:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92062024-09-09T17:59:43.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92072024-09-09T17:59:43.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
92082024-09-09T17:59:43.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92092024-09-09T17:59:43.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92102024-09-09T17:59:43.457ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
92112024-09-09T17:59:43.457ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.286413ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
92122024-09-09T17:59:43.468ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92132024-09-09T17:59:43.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92142024-09-09T17:59:43.494ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.141108ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92152024-09-09T17:59:43.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 359515fa-09b5-4944-a0db-02774ce373ed roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92162024-09-09T17:59:43.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 359515fa-09b5-4944-a0db-02774ce373ed resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92172024-09-09T17:59:43.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 359515fa-09b5-4944-a0db-02774ce373ed response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92182024-09-09T17:59:44.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 31d18858-f02e-4dea-893a-fbfae259ec34 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92192024-09-09T17:59:44.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 31d18858-f02e-4dea-893a-fbfae259ec34 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92202024-09-09T17:59:44.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 31d18858-f02e-4dea-893a-fbfae259ec34 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92212024-09-09T17:59:45.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = e0cb9289-b875-4383-b064-8d5bd3b2a7da roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92222024-09-09T17:59:45.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = e0cb9289-b875-4383-b064-8d5bd3b2a7da resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92232024-09-09T17:59:45.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = e0cb9289-b875-4383-b064-8d5bd3b2a7da response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92242024-09-09T17:59:45.686ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1273 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = e035aeb9-c7b5-4f45-a945-659c7a8228c2 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
92252024-09-09T17:59:46.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 9896eda3-c17a-4939-b70f-fe33c0b2813d roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92262024-09-09T17:59:46.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 9896eda3-c17a-4939-b70f-fe33c0b2813d resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92272024-09-09T17:59:46.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 9896eda3-c17a-4939-b70f-fe33c0b2813d response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92282024-09-09T17:59:47.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 2db2a564-d683-46a2-9ba4-be735d5334d3 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92292024-09-09T17:59:47.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 2db2a564-d683-46a2-9ba4-be735d5334d3 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92302024-09-09T17:59:47.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 2db2a564-d683-46a2-9ba4-be735d5334d3 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92312024-09-09T17:59:48.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f1d84469-e6e1-4d03-9dad-acffb897b3e1 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92322024-09-09T17:59:48.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f1d84469-e6e1-4d03-9dad-acffb897b3e1 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92332024-09-09T17:59:48.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f1d84469-e6e1-4d03-9dad-acffb897b3e1 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92342024-09-09T17:59:49.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 031c6e49-00d8-4e71-b14e-a4a166092a7e roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92352024-09-09T17:59:49.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 031c6e49-00d8-4e71-b14e-a4a166092a7e resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92362024-09-09T17:59:49.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 031c6e49-00d8-4e71-b14e-a4a166092a7e response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92372024-09-09T17:59:50.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1630a8a0-c7d1-4509-bfb0-b9e647c24175 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92382024-09-09T17:59:50.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1630a8a0-c7d1-4509-bfb0-b9e647c24175 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92392024-09-09T17:59:50.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1630a8a0-c7d1-4509-bfb0-b9e647c24175 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92402024-09-09T17:59:51.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 7181b04c-6f00-41a6-9c62-f4246f148e89 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92412024-09-09T17:59:51.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 7181b04c-6f00-41a6-9c62-f4246f148e89 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92422024-09-09T17:59:51.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 7181b04c-6f00-41a6-9c62-f4246f148e89 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92432024-09-09T17:59:52.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = ccf2a6fa-728b-4567-924d-cdcca017ff12 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92442024-09-09T17:59:52.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = ccf2a6fa-728b-4567-924d-cdcca017ff12 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92452024-09-09T17:59:52.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = ccf2a6fa-728b-4567-924d-cdcca017ff12 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
92462024-09-09T17:59:53.439ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
92472024-09-09T17:59:53.439ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
92482024-09-09T17:59:53.439ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
92492024-09-09T17:59:53.439ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92502024-09-09T17:59:53.439ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92512024-09-09T17:59:53.439ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
92522024-09-09T17:59:53.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92532024-09-09T17:59:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92542024-09-09T17:59:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92552024-09-09T17:59:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92562024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
92572024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
92582024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
92592024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92602024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92612024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
92622024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
92632024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92642024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92652024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92662024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
92672024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
92682024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92692024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
92702024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92712024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92722024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
92732024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
92742024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92752024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92762024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
92772024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92782024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92792024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
92802024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92812024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
92822024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92832024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92842024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92852024-09-09T17:59:53.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92862024-09-09T17:59:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92872024-09-09T17:59:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92882024-09-09T17:59:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92892024-09-09T17:59:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92902024-09-09T17:59:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92912024-09-09T17:59:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92922024-09-09T17:59:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92932024-09-09T17:59:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92942024-09-09T17:59:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92952024-09-09T17:59:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92962024-09-09T17:59:53.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92972024-09-09T17:59:53.443ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.054914ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92982024-09-09T17:59:53.443ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 34115, tv_nsec: 39339920 } })
92992024-09-09T17:59:53.444ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 34115, tv_nsec: 39553722 } })
93002024-09-09T17:59:53.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93012024-09-09T17:59:53.445ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
93022024-09-09T17:59:53.445ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
93032024-09-09T17:59:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93042024-09-09T17:59:53.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93052024-09-09T17:59:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93062024-09-09T17:59:53.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93072024-09-09T17:59:53.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93082024-09-09T17:59:53.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93092024-09-09T17:59:53.454ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93102024-09-09T17:59:53.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93112024-09-09T17:59:53.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93122024-09-09T17:59:53.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93132024-09-09T17:59:53.457ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93142024-09-09T17:59:53.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93152024-09-09T17:59:53.460ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 34115, tv_nsec: 55900157 } })
93162024-09-09T17:59:53.460ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93172024-09-09T17:59:53.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93182024-09-09T17:59:53.462ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
93192024-09-09T17:59:53.483ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93202024-09-09T17:59:53.483ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93212024-09-09T17:59:53.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93222024-09-09T17:59:53.485ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 44.829323ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
93232024-09-09T17:59:53.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93242024-09-09T17:59:53.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93252024-09-09T17:59:53.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93262024-09-09T17:59:53.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93272024-09-09T17:59:53.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93282024-09-09T17:59:53.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93292024-09-09T17:59:53.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93302024-09-09T17:59:53.495ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93312024-09-09T17:59:53.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93322024-09-09T17:59:53.497ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.907974ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
93332024-09-09T17:59:53.498ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.803049ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
93342024-09-09T17:59:53.504ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93352024-09-09T17:59:53.505ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93362024-09-09T17:59:53.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93372024-09-09T17:59:53.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93382024-09-09T17:59:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93392024-09-09T17:59:53.506ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93402024-09-09T17:59:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93412024-09-09T17:59:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
93422024-09-09T17:59:53.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93432024-09-09T17:59:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93442024-09-09T17:59:53.511ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
93452024-09-09T17:59:53.511ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93462024-09-09T17:59:53.511ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93472024-09-09T17:59:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93482024-09-09T17:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93492024-09-09T17:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93502024-09-09T17:59:53.517ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93512024-09-09T17:59:53.520ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93522024-09-09T17:59:53.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93532024-09-09T17:59:53.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93542024-09-09T17:59:53.522ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93552024-09-09T17:59:53.525ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93562024-09-09T17:59:53.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93572024-09-09T17:59:53.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93582024-09-09T17:59:53.526ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
93592024-09-09T17:59:53.526ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 87.220071ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
93602024-09-09T17:59:53.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93612024-09-09T17:59:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93622024-09-09T17:59:53.529ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93632024-09-09T17:59:53.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93642024-09-09T17:59:53.531ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.987083ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93652024-09-09T17:59:53.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93662024-09-09T17:59:53.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93672024-09-09T17:59:53.548ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93682024-09-09T17:59:53.548ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 107.837652ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
93692024-09-09T17:59:53.551ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93702024-09-09T17:59:53.552ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
93712024-09-09T17:59:53.552ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93722024-09-09T17:59:53.552ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cb15c142-e60e-406b-8285-4745b1dcf1b2", "content-length": "26", "date": "Mon, 09 Sep 2024 17:59:53 GMT"} })
93732024-09-09T17:59:53.552ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93742024-09-09T17:59:53.553ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
93752024-09-09T17:59:53.553ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93762024-09-09T17:59:53.553ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 112.565879ms iteration = 16 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
93772024-09-09T17:59:53.553ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
93782024-09-09T17:59:53.553ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93792024-09-09T17:59:53.554ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2d7dcb5d-fa96-41e8-92ec-4533ab151fbd", "content-length": "26", "date": "Mon, 09 Sep 2024 17:59:53 GMT"} })
93802024-09-09T17:59:53.554ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93812024-09-09T17:59:53.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93822024-09-09T17:59:53.554ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f zone_address = fd00:1122:3344:101::2
93832024-09-09T17:59:53.554ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93842024-09-09T17:59:53.554ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93852024-09-09T17:59:53.555ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "76746c68-d9df-4da8-ad9d-c283a7485664", "content-length": "26", "date": "Mon, 09 Sep 2024 17:59:53 GMT"} })
93862024-09-09T17:59:53.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93872024-09-09T17:59:53.555ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93882024-09-09T17:59:53.555ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93892024-09-09T17:59:53.556ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93902024-09-09T17:59:53.556ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
93912024-09-09T17:59:53.557ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 116.746514ms iteration = 16 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
93922024-09-09T17:59:53.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93932024-09-09T17:59:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
93942024-09-09T17:59:53.577ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93952024-09-09T17:59:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93962024-09-09T17:59:53.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.23646ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
93972024-09-09T17:59:53.580ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 139.579818ms iteration = 16 status = 0
93982024-09-09T17:59:53.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93992024-09-09T17:59:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94002024-09-09T17:59:53.586ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94012024-09-09T17:59:53.588ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94022024-09-09T17:59:53.588ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94032024-09-09T17:59:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94042024-09-09T17:59:53.589ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94052024-09-09T17:59:53.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94062024-09-09T17:59:53.591ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94072024-09-09T17:59:53.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94082024-09-09T17:59:53.646ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
94092024-09-09T17:59:53.647ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5153e5ac-350b-4168-9ae6-f4264f9a3999", "content-length": "2", "date": "Mon, 09 Sep 2024 17:59:52 GMT"} })
94102024-09-09T17:59:53.648ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94112024-09-09T17:59:53.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94122024-09-09T17:59:53.651ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 211.846541ms iteration = 16 status = null
94132024-09-09T17:59:53.658ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 219.202944ms iteration = 16 status = {}
94142024-09-09T17:59:53.661ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 220.503652ms iteration = 18 status = {"physical_disks_added":0}
94152024-09-09T17:59:53.694ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94162024-09-09T17:59:53.695ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a2c61154-e9fb-406f-baa2-ef331033800d", "content-length": "372", "date": "Mon, 09 Sep 2024 17:59:53 GMT"} })
94172024-09-09T17:59:53.695ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94182024-09-09T17:59:53.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94192024-09-09T17:59:53.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94202024-09-09T17:59:53.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94212024-09-09T17:59:53.701ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94222024-09-09T17:59:53.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94232024-09-09T17:59:53.704ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94242024-09-09T17:59:53.704ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "21d78d37-a187-4f24-81bd-56bddc5bb3dc", "date": "Mon, 09 Sep 2024 17:59:53 GMT"} })
94252024-09-09T17:59:53.706ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 266.120749ms iteration = 18 status = {}
94262024-09-09T17:59:53.727ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
94272024-09-09T17:59:53.727ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5d2c7380-f55e-45c2-ada6-30049868f4e7", "content-length": "691", "date": "Mon, 09 Sep 2024 17:59:53 GMT"} })
94282024-09-09T17:59:53.727ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
94292024-09-09T17:59:53.727ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
94302024-09-09T17:59:53.727ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
94312024-09-09T17:59:53.728ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 287.979397ms iteration = 17 status = {}
94322024-09-09T17:59:53.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94332024-09-09T17:59:53.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94342024-09-09T17:59:53.764ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 8ddbbc53-8b49-46f3-8c46-10ed4300f6d2, rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e) } rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
94352024-09-09T17:59:53.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94362024-09-09T17:59:53.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94372024-09-09T17:59:53.774ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
94382024-09-09T17:59:53.774ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ed5550a4-0701-4025-ba94-875b537f70a8", "content-length": "121", "date": "Mon, 09 Sep 2024 17:59:52 GMT"} })
94392024-09-09T17:59:53.774ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
94402024-09-09T17:59:53.774ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e
94412024-09-09T17:59:53.775ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
94422024-09-09T17:59:53.775ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
94432024-09-09T17:59:53.775ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
94442024-09-09T17:59:53.775ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
94452024-09-09T17:59:53.775ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
94462024-09-09T17:59:53.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94472024-09-09T17:59:53.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94482024-09-09T17:59:53.776ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
94492024-09-09T17:59:53.777ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e32bbc2e-5b28-4bc3-91ca-ef7aff0cb5c8", "content-length": "2", "date": "Mon, 09 Sep 2024 17:59:52 GMT"} })
94502024-09-09T17:59:53.777ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
94512024-09-09T17:59:53.777ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6d0e6509-0088-4313-819b-65b55fa8f904", "content-length": "51", "date": "Mon, 09 Sep 2024 17:59:52 GMT"} })
94522024-09-09T17:59:53.777ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
94532024-09-09T17:59:53.777ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94542024-09-09T17:59:53.905ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8fb48584-e853-44d2-a069-43970711ee20", "date": "Mon, 09 Sep 2024 17:59:53 GMT"} })
94552024-09-09T17:59:53.905ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch = Switch0
94562024-09-09T17:59:53.905ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
94572024-09-09T17:59:53.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = d7101c33-e667-488b-b4ab-55737b49bdf1 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94582024-09-09T17:59:53.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = d7101c33-e667-488b-b4ab-55737b49bdf1 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94592024-09-09T17:59:53.906ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3ed891a1-2a65-4ea9-827f-29822d25c515", "content-length": "667", "date": "Mon, 09 Sep 2024 17:59:53 GMT"} })
94602024-09-09T17:59:53.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94612024-09-09T17:59:53.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94622024-09-09T17:59:53.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = d7101c33-e667-488b-b4ab-55737b49bdf1 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94632024-09-09T17:59:53.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94642024-09-09T17:59:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94652024-09-09T17:59:53.914ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94662024-09-09T17:59:53.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94672024-09-09T17:59:53.917ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94682024-09-09T17:59:53.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94692024-09-09T17:59:53.925ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 484.800411ms iteration = 16 status = {}
94702024-09-09T17:59:55.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 11af06a5-c99f-4b76-85e9-0248501a8d2f roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94712024-09-09T17:59:55.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 11af06a5-c99f-4b76-85e9-0248501a8d2f resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94722024-09-09T17:59:55.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 11af06a5-c99f-4b76-85e9-0248501a8d2f response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94732024-09-09T17:59:55.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1233 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = eaab96e3-2f17-4a77-b9ef-7712ea385179 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
94742024-09-09T17:59:56.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 4e96ef93-75dc-4f15-80cf-32b9749a306f roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94752024-09-09T17:59:56.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 4e96ef93-75dc-4f15-80cf-32b9749a306f resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94762024-09-09T17:59:56.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 4e96ef93-75dc-4f15-80cf-32b9749a306f response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94772024-09-09T17:59:57.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b8eac60c-77fd-44a5-bbdc-120d29a2898c roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94782024-09-09T17:59:57.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b8eac60c-77fd-44a5-bbdc-120d29a2898c resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94792024-09-09T17:59:57.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b8eac60c-77fd-44a5-bbdc-120d29a2898c response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94802024-09-09T17:59:57.278ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:50817
94812024-09-09T17:59:57.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50817 req_id = fb962182-8557-4062-b621-414e34ab711c roles = RoleSet { roles: {} } uri = /metrics/producers
94822024-09-09T17:59:57.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50817 req_id = fb962182-8557-4062-b621-414e34ab711c resource = Database result = Ok(()) uri = /metrics/producers
94832024-09-09T17:59:57.311ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
94842024-09-09T17:59:57.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50817 req_id = fb962182-8557-4062-b621-414e34ab711c roles = RoleSet { roles: {} } uri = /metrics/producers
94852024-09-09T17:59:57.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50817 req_id = fb962182-8557-4062-b621-414e34ab711c resource = Database result = Ok(()) uri = /metrics/producers
94862024-09-09T17:59:57.345ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
94872024-09-09T17:59:57.345ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a86574c1-52d0-43d4-beae-f8c46fec0f41", "date": "Mon, 09 Sep 2024 17:59:57 GMT"} })
94882024-09-09T17:59:57.345ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 11e4ca7f-2a45-4733-9ef1-4614c608a84b
94892024-09-09T17:59:57.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 67189 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50817 req_id = fb962182-8557-4062-b621-414e34ab711c response_code = 201 uri = /metrics/producers
94902024-09-09T17:59:58.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b8101571-ca61-449f-8839-db303b65e0b5 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94912024-09-09T17:59:58.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b8101571-ca61-449f-8839-db303b65e0b5 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94922024-09-09T17:59:58.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b8101571-ca61-449f-8839-db303b65e0b5 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94932024-09-09T17:59:59.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bb63d885-7715-4ccc-b2c4-17d5a3e72eb4 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94942024-09-09T17:59:59.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bb63d885-7715-4ccc-b2c4-17d5a3e72eb4 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94952024-09-09T17:59:59.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bb63d885-7715-4ccc-b2c4-17d5a3e72eb4 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94962024-09-09T18:00:00.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3946b5e6-54e1-4a2d-a509-18a9dbdc2812 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94972024-09-09T18:00:00.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3946b5e6-54e1-4a2d-a509-18a9dbdc2812 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94982024-09-09T18:00:00.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 3946b5e6-54e1-4a2d-a509-18a9dbdc2812 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
94992024-09-09T18:00:00.464ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35197
95002024-09-09T18:00:00.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35197 req_id = 1cc3a88a-11dd-4128-be4b-86e0be5e4fa4 roles = RoleSet { roles: {} } uri = /metrics/producers
95012024-09-09T18:00:00.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35197 req_id = 1cc3a88a-11dd-4128-be4b-86e0be5e4fa4 resource = Database result = Ok(()) uri = /metrics/producers
95022024-09-09T18:00:00.496ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
95032024-09-09T18:00:00.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35197 req_id = 1cc3a88a-11dd-4128-be4b-86e0be5e4fa4 roles = RoleSet { roles: {} } uri = /metrics/producers
95042024-09-09T18:00:00.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35197 req_id = 1cc3a88a-11dd-4128-be4b-86e0be5e4fa4 resource = Database result = Ok(()) uri = /metrics/producers
95052024-09-09T18:00:00.507ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
95062024-09-09T18:00:00.507ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e2238f44-a558-4d50-842e-b9b79f8076d9", "date": "Mon, 09 Sep 2024 18:00:00 GMT"} })
95072024-09-09T18:00:00.507ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = fdca555f-3b9a-4118-ba07-7428edbb0dfc
95082024-09-09T18:00:00.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 45118 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35197 req_id = 1cc3a88a-11dd-4128-be4b-86e0be5e4fa4 response_code = 201 uri = /metrics/producers
95092024-09-09T18:00:01.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1ecd85f4-357f-4eef-a66c-5c3b447a5388 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95102024-09-09T18:00:01.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1ecd85f4-357f-4eef-a66c-5c3b447a5388 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95112024-09-09T18:00:01.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1ecd85f4-357f-4eef-a66c-5c3b447a5388 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95122024-09-09T18:00:02.040ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:64794
95132024-09-09T18:00:02.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64794 req_id = 4d7c648c-89dd-4f1f-a0a5-1fd0580cb977 roles = RoleSet { roles: {} } uri = /metrics/producers
95142024-09-09T18:00:02.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64794 req_id = 4d7c648c-89dd-4f1f-a0a5-1fd0580cb977 resource = Database result = Ok(()) uri = /metrics/producers
95152024-09-09T18:00:02.074ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
95162024-09-09T18:00:02.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64794 req_id = 4d7c648c-89dd-4f1f-a0a5-1fd0580cb977 roles = RoleSet { roles: {} } uri = /metrics/producers
95172024-09-09T18:00:02.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64794 req_id = 4d7c648c-89dd-4f1f-a0a5-1fd0580cb977 resource = Database result = Ok(()) uri = /metrics/producers
95182024-09-09T18:00:02.110ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
95192024-09-09T18:00:02.110ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "24e6c654-d03d-4792-a2bf-f31220c70a2a", "date": "Mon, 09 Sep 2024 18:00:02 GMT"} })
95202024-09-09T18:00:02.110ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95212024-09-09T18:00:02.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 71580 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64794 req_id = 4d7c648c-89dd-4f1f-a0a5-1fd0580cb977 response_code = 201 uri = /metrics/producers
95222024-09-09T18:00:02.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = ebb3c322-322f-4381-9131-ced0cb4393ed roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95232024-09-09T18:00:02.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = ebb3c322-322f-4381-9131-ced0cb4393ed resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95242024-09-09T18:00:02.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = ebb3c322-322f-4381-9131-ced0cb4393ed response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95252024-09-09T18:00:03.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 7424ac5c-8d7a-40e0-be59-30ba8d6f80b9 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95262024-09-09T18:00:03.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 7424ac5c-8d7a-40e0-be59-30ba8d6f80b9 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95272024-09-09T18:00:03.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 7424ac5c-8d7a-40e0-be59-30ba8d6f80b9 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95282024-09-09T18:00:03.439ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
95292024-09-09T18:00:03.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95302024-09-09T18:00:03.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95312024-09-09T18:00:03.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
95322024-09-09T18:00:03.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95332024-09-09T18:00:03.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95342024-09-09T18:00:03.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95352024-09-09T18:00:03.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95362024-09-09T18:00:03.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95372024-09-09T18:00:03.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95382024-09-09T18:00:03.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95392024-09-09T18:00:03.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95402024-09-09T18:00:03.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95412024-09-09T18:00:03.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95422024-09-09T18:00:03.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95432024-09-09T18:00:03.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
95442024-09-09T18:00:03.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95452024-09-09T18:00:03.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95462024-09-09T18:00:03.458ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
95472024-09-09T18:00:03.458ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.181822ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
95482024-09-09T18:00:03.469ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.500703ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95492024-09-09T18:00:04.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 62a9697e-490b-4b12-bad2-2d2c416674b6 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95502024-09-09T18:00:04.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 62a9697e-490b-4b12-bad2-2d2c416674b6 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95512024-09-09T18:00:04.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 62a9697e-490b-4b12-bad2-2d2c416674b6 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95522024-09-09T18:00:05.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f814cf3e-eeae-42f0-a62d-b99aa2d654e1 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95532024-09-09T18:00:05.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f814cf3e-eeae-42f0-a62d-b99aa2d654e1 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95542024-09-09T18:00:05.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f814cf3e-eeae-42f0-a62d-b99aa2d654e1 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95552024-09-09T18:00:05.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1646 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 407e572d-e001-43e0-9123-869a49708568 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
95562024-09-09T18:00:06.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bcc4c769-d6b8-4b1f-870f-d29247e980a1 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95572024-09-09T18:00:06.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bcc4c769-d6b8-4b1f-870f-d29247e980a1 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95582024-09-09T18:00:06.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2776 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bcc4c769-d6b8-4b1f-870f-d29247e980a1 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95592024-09-09T18:00:07.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 2dbd9ea7-bfdf-4545-a187-a89e3121f253 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95602024-09-09T18:00:07.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 2dbd9ea7-bfdf-4545-a187-a89e3121f253 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95612024-09-09T18:00:07.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 2dbd9ea7-bfdf-4545-a187-a89e3121f253 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95622024-09-09T18:00:08.073ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:38064
95632024-09-09T18:00:08.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38064 req_id = 493b1cd5-9967-4de1-8702-0a9e078e7fd0 roles = RoleSet { roles: {} } uri = /metrics/producers
95642024-09-09T18:00:08.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38064 req_id = 493b1cd5-9967-4de1-8702-0a9e078e7fd0 resource = Database result = Ok(()) uri = /metrics/producers
95652024-09-09T18:00:08.107ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
95662024-09-09T18:00:08.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38064 req_id = 493b1cd5-9967-4de1-8702-0a9e078e7fd0 roles = RoleSet { roles: {} } uri = /metrics/producers
95672024-09-09T18:00:08.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38064 req_id = 493b1cd5-9967-4de1-8702-0a9e078e7fd0 resource = Database result = Ok(()) uri = /metrics/producers
95682024-09-09T18:00:08.142ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
95692024-09-09T18:00:08.143ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8c54aede-265c-4a6d-b1d7-84a9607b1565", "date": "Mon, 09 Sep 2024 18:00:08 GMT"} })
95702024-09-09T18:00:08.143ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = fd6a3800-ebfc-41fd-a922-894d8d51ff21
95712024-09-09T18:00:08.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 72285 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38064 req_id = 493b1cd5-9967-4de1-8702-0a9e078e7fd0 response_code = 201 uri = /metrics/producers
95722024-09-09T18:00:08.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 94e02fdb-cf0b-4208-8a89-6682ee15e47c roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95732024-09-09T18:00:08.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 94e02fdb-cf0b-4208-8a89-6682ee15e47c resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95742024-09-09T18:00:08.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 94e02fdb-cf0b-4208-8a89-6682ee15e47c response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95752024-09-09T18:00:09.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 83a9e9e3-5721-4c69-8df0-f4e30340b040 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95762024-09-09T18:00:09.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 83a9e9e3-5721-4c69-8df0-f4e30340b040 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95772024-09-09T18:00:09.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 83a9e9e3-5721-4c69-8df0-f4e30340b040 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95782024-09-09T18:00:10.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 79e48950-c26a-4d28-b76a-3f5fd58d7ce2 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95792024-09-09T18:00:10.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 79e48950-c26a-4d28-b76a-3f5fd58d7ce2 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95802024-09-09T18:00:10.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 79e48950-c26a-4d28-b76a-3f5fd58d7ce2 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95812024-09-09T18:00:11.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = d5c61180-3b5c-426c-ac6b-fcc9d4361383 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95822024-09-09T18:00:11.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = d5c61180-3b5c-426c-ac6b-fcc9d4361383 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95832024-09-09T18:00:11.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2704 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = d5c61180-3b5c-426c-ac6b-fcc9d4361383 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95842024-09-09T18:00:12.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = a0b4025d-7334-4a07-88b0-bdbbd0d1c029 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95852024-09-09T18:00:12.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = a0b4025d-7334-4a07-88b0-bdbbd0d1c029 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95862024-09-09T18:00:12.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = a0b4025d-7334-4a07-88b0-bdbbd0d1c029 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95872024-09-09T18:00:13.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 63a4951a-a946-4473-a92e-33b37b522d73 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95882024-09-09T18:00:13.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 63a4951a-a946-4473-a92e-33b37b522d73 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95892024-09-09T18:00:13.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 63a4951a-a946-4473-a92e-33b37b522d73 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
95902024-09-09T18:00:13.439ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
95912024-09-09T18:00:13.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95922024-09-09T18:00:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95932024-09-09T18:00:13.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
95942024-09-09T18:00:13.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95952024-09-09T18:00:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95962024-09-09T18:00:13.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95972024-09-09T18:00:13.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95982024-09-09T18:00:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95992024-09-09T18:00:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96002024-09-09T18:00:13.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96012024-09-09T18:00:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96022024-09-09T18:00:13.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96032024-09-09T18:00:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96042024-09-09T18:00:13.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96052024-09-09T18:00:13.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
96062024-09-09T18:00:13.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96072024-09-09T18:00:13.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96082024-09-09T18:00:13.459ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
96092024-09-09T18:00:13.459ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.772346ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
96102024-09-09T18:00:13.473ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.862513ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96112024-09-09T18:00:14.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 9c6ca1e4-9f28-4307-aa21-8642bfd6c9c4 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96122024-09-09T18:00:14.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 9c6ca1e4-9f28-4307-aa21-8642bfd6c9c4 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96132024-09-09T18:00:14.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 9c6ca1e4-9f28-4307-aa21-8642bfd6c9c4 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96142024-09-09T18:00:15.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = d634faf9-1dc9-4b59-9d76-264bb1e8924f roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96152024-09-09T18:00:15.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = d634faf9-1dc9-4b59-9d76-264bb1e8924f resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96162024-09-09T18:00:15.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = d634faf9-1dc9-4b59-9d76-264bb1e8924f response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96172024-09-09T18:00:15.688ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1294 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 7f71ba15-29b9-46df-a66d-39f069abdbc6 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
96182024-09-09T18:00:16.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = a1a6764c-66d7-4b5a-adbc-f7c0623f0a2a roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96192024-09-09T18:00:16.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = a1a6764c-66d7-4b5a-adbc-f7c0623f0a2a resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96202024-09-09T18:00:16.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = a1a6764c-66d7-4b5a-adbc-f7c0623f0a2a response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96212024-09-09T18:00:17.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = edcf8511-e5ac-4c06-9189-6038dfcb3d7e roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96222024-09-09T18:00:17.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = edcf8511-e5ac-4c06-9189-6038dfcb3d7e resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96232024-09-09T18:00:17.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = edcf8511-e5ac-4c06-9189-6038dfcb3d7e response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96242024-09-09T18:00:18.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f97b0d22-1df7-4c4f-a643-c787e1bb2d0c roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96252024-09-09T18:00:18.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f97b0d22-1df7-4c4f-a643-c787e1bb2d0c resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96262024-09-09T18:00:18.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f97b0d22-1df7-4c4f-a643-c787e1bb2d0c response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96272024-09-09T18:00:19.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = e45d9990-3bf9-4afd-b358-96919e780d4a roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96282024-09-09T18:00:19.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = e45d9990-3bf9-4afd-b358-96919e780d4a resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96292024-09-09T18:00:19.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = e45d9990-3bf9-4afd-b358-96919e780d4a response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96302024-09-09T18:00:20.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 0e62bf0e-2ac2-4b71-9cba-1a02577a034b roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96312024-09-09T18:00:20.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 0e62bf0e-2ac2-4b71-9cba-1a02577a034b resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96322024-09-09T18:00:20.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 0e62bf0e-2ac2-4b71-9cba-1a02577a034b response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96332024-09-09T18:00:21.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 8685fa62-8406-400e-b77f-3eebeb32e754 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96342024-09-09T18:00:21.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 8685fa62-8406-400e-b77f-3eebeb32e754 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96352024-09-09T18:00:21.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 8685fa62-8406-400e-b77f-3eebeb32e754 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96362024-09-09T18:00:22.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 9bd83243-35ea-4060-9e2a-29e11f60f92e roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96372024-09-09T18:00:22.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 9bd83243-35ea-4060-9e2a-29e11f60f92e resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96382024-09-09T18:00:22.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 9bd83243-35ea-4060-9e2a-29e11f60f92e response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
96392024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
96402024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
96412024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96422024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
96432024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
96442024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
96452024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96462024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96472024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
96482024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96492024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
96502024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96512024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
96522024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
96532024-09-09T18:00:23.440ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b
96542024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.7\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b"}
96552024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
96562024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
96572024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
96582024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
96592024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96602024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
96612024-09-09T18:00:23.440ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-09 17:50:23.440279270 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
96622024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
96632024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
96642024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
96652024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96662024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
96672024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
96682024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96692024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
96702024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96712024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96722024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
96732024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
96742024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96752024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96762024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96772024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
96782024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96792024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
96802024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96812024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
96822024-09-09T18:00:23.440ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
96832024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
96842024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96852024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96862024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
96872024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96882024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96892024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
96902024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
96912024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
96922024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96932024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
96942024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96952024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96962024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
96972024-09-09T18:00:23.440ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
96982024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
96992024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97002024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
97012024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
97022024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97032024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
97042024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
97052024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97062024-09-09T18:00:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97072024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97082024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
97092024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97102024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97112024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97122024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97132024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97142024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
97152024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
97162024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97172024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97182024-09-09T18:00:23.441ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("07c1bbdd-f080-4837-9528-41234be47bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9711344c-11c4-490b-9560-e9c007eb0cf3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 34145, tv_nsec: 35973206 } })
97192024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97202024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97212024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97222024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97232024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97242024-09-09T18:00:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97252024-09-09T18:00:23.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97262024-09-09T18:00:23.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97272024-09-09T18:00:23.442ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("21f5073c-362d-497d-ae9e-f6ab85374703.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("42b0964a-b1a3-443e-b006-c18e1ad8d003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9704e6fa-a599-4b20-92b9-bc19ae282ee4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 34145, tv_nsec: 37552905 } })
97282024-09-09T18:00:23.443ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
97292024-09-09T18:00:23.443ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.44727ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
97302024-09-09T18:00:23.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97312024-09-09T18:00:23.445ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.229941ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97322024-09-09T18:00:23.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97332024-09-09T18:00:23.446ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-09 17:50:23.440279270 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
97342024-09-09T18:00:23.446ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.475247ms iteration = 9 status = {"expiration":"2024-09-09T17:50:23.440279270Z","pruned":[]}
97352024-09-09T18:00:23.446ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97362024-09-09T18:00:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97372024-09-09T18:00:23.447ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
97382024-09-09T18:00:23.447ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 7.122022ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
97392024-09-09T18:00:23.448ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 34145, tv_nsec: 42925266 } })
97402024-09-09T18:00:23.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97412024-09-09T18:00:23.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97422024-09-09T18:00:23.448ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 34145, tv_nsec: 43097607 } })
97432024-09-09T18:00:23.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97442024-09-09T18:00:23.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
97452024-09-09T18:00:23.449ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97462024-09-09T18:00:23.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97472024-09-09T18:00:23.451ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
97482024-09-09T18:00:23.451ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
97492024-09-09T18:00:23.451ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.084025ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
97502024-09-09T18:00:23.451ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97512024-09-09T18:00:23.452ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97522024-09-09T18:00:23.453ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97532024-09-09T18:00:23.453ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.109177ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
97542024-09-09T18:00:23.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97552024-09-09T18:00:23.455ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97562024-09-09T18:00:23.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97572024-09-09T18:00:23.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97582024-09-09T18:00:23.456ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97592024-09-09T18:00:23.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97602024-09-09T18:00:23.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97612024-09-09T18:00:23.456ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97622024-09-09T18:00:23.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97632024-09-09T18:00:23.463ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97642024-09-09T18:00:23.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97652024-09-09T18:00:23.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97662024-09-09T18:00:23.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97672024-09-09T18:00:23.477ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97682024-09-09T18:00:23.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97692024-09-09T18:00:23.478ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97702024-09-09T18:00:23.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97712024-09-09T18:00:23.484ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97722024-09-09T18:00:23.488ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97732024-09-09T18:00:23.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97742024-09-09T18:00:23.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97752024-09-09T18:00:23.488ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
97762024-09-09T18:00:23.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97772024-09-09T18:00:23.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97782024-09-09T18:00:23.489ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97792024-09-09T18:00:23.490ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
97802024-09-09T18:00:23.490ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 49.844052ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
97812024-09-09T18:00:23.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97822024-09-09T18:00:23.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
97832024-09-09T18:00:23.492ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97842024-09-09T18:00:23.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97852024-09-09T18:00:23.496ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97862024-09-09T18:00:23.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97872024-09-09T18:00:23.499ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97882024-09-09T18:00:23.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97892024-09-09T18:00:23.504ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
97902024-09-09T18:00:23.504ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.742419ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
97912024-09-09T18:00:23.506ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.131017ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
97922024-09-09T18:00:23.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97932024-09-09T18:00:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97942024-09-09T18:00:23.509ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97952024-09-09T18:00:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
97962024-09-09T18:00:23.512ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97972024-09-09T18:00:23.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97982024-09-09T18:00:23.514ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97992024-09-09T18:00:23.515ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98002024-09-09T18:00:23.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98012024-09-09T18:00:23.516ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
98022024-09-09T18:00:23.516ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98032024-09-09T18:00:23.516ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98042024-09-09T18:00:23.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98052024-09-09T18:00:23.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
98062024-09-09T18:00:23.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98072024-09-09T18:00:23.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98082024-09-09T18:00:23.518ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 77.654555ms iteration = 17 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
98092024-09-09T18:00:23.521ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-61e07fcc-45b4-4b25-ae0d-e78eee62eb60.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 34145, tv_nsec: 115886954 } })
98102024-09-09T18:00:23.522ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98112024-09-09T18:00:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98122024-09-09T18:00:23.523ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
98132024-09-09T18:00:23.523ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
98142024-09-09T18:00:23.523ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
98152024-09-09T18:00:23.523ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.055147ms iteration = 9 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
98162024-09-09T18:00:23.524ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
98172024-09-09T18:00:23.524ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98182024-09-09T18:00:23.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
98192024-09-09T18:00:23.525ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98202024-09-09T18:00:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98212024-09-09T18:00:23.526ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98222024-09-09T18:00:23.526ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98232024-09-09T18:00:23.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98242024-09-09T18:00:23.534ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98252024-09-09T18:00:23.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 61e07fcc-45b4-4b25-ae0d-e78eee62eb60, lookup_type: ById(61e07fcc-45b4-4b25-ae0d-e78eee62eb60) } result = Ok(())
98262024-09-09T18:00:23.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98272024-09-09T18:00:23.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98282024-09-09T18:00:23.543ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
98292024-09-09T18:00:23.543ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
98302024-09-09T18:00:23.543ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
98312024-09-09T18:00:23.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98322024-09-09T18:00:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98332024-09-09T18:00:23.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 108.945008ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98342024-09-09T18:00:23.549ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98352024-09-09T18:00:23.549ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.428581ms iteration = 17 status = 0
98362024-09-09T18:00:23.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98372024-09-09T18:00:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98382024-09-09T18:00:23.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98392024-09-09T18:00:23.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98402024-09-09T18:00:23.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98412024-09-09T18:00:23.555ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
98422024-09-09T18:00:23.555ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
98432024-09-09T18:00:23.555ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
98442024-09-09T18:00:23.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98452024-09-09T18:00:23.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98462024-09-09T18:00:23.556ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98472024-09-09T18:00:23.556ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98482024-09-09T18:00:23.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98492024-09-09T18:00:23.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98502024-09-09T18:00:23.557ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
98512024-09-09T18:00:23.557ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98522024-09-09T18:00:23.558ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2dd9a0f8-9265-40b0-bff1-0bb42b20719e", "content-length": "26", "date": "Mon, 09 Sep 2024 18:00:23 GMT"} })
98532024-09-09T18:00:23.558ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98542024-09-09T18:00:23.558ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
98552024-09-09T18:00:23.558ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98562024-09-09T18:00:23.558ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.481715ms iteration = 17 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
98572024-09-09T18:00:23.559ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98582024-09-09T18:00:23.559ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98592024-09-09T18:00:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98602024-09-09T18:00:23.560ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98612024-09-09T18:00:23.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98622024-09-09T18:00:23.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98632024-09-09T18:00:23.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98642024-09-09T18:00:23.561ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
98652024-09-09T18:00:23.561ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
98662024-09-09T18:00:23.561ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 121.029609ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
98672024-09-09T18:00:23.563ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
98682024-09-09T18:00:23.563ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
98692024-09-09T18:00:23.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98702024-09-09T18:00:23.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98712024-09-09T18:00:23.565ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98722024-09-09T18:00:23.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98732024-09-09T18:00:23.569ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98742024-09-09T18:00:23.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98752024-09-09T18:00:23.573ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc900307-69d6-4642-8a28-2bf207700f84 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
98762024-09-09T18:00:23.573ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
98772024-09-09T18:00:23.573ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-09 17:52:53.875764 UTC dns_group = internal generation = 1
98782024-09-09T18:00:23.573ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 133.598942ms iteration = 10 status = {"generation":1}
98792024-09-09T18:00:23.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 138.439941ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
98802024-09-09T18:00:23.581ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
98812024-09-09T18:00:23.582ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
98822024-09-09T18:00:23.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98832024-09-09T18:00:23.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98842024-09-09T18:00:23.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98852024-09-09T18:00:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98862024-09-09T18:00:23.599ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
98872024-09-09T18:00:23.599ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 0 version = 2
98882024-09-09T18:00:23.599ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98892024-09-09T18:00:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98902024-09-09T18:00:23.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98912024-09-09T18:00:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98922024-09-09T18:00:23.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98932024-09-09T18:00:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98942024-09-09T18:00:23.605ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0376020f-c7a8-4243-a641-0bc96ca63f25 dns_zone_name = oxide.test found_so_far = 1 version = 2
98952024-09-09T18:00:23.605ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
98962024-09-09T18:00:23.605ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-09 17:52:54.528560 UTC dns_group = external generation = 2
98972024-09-09T18:00:23.605ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 164.943666ms iteration = 10 status = {"generation":2}
98982024-09-09T18:00:23.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 166.304105ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
98992024-09-09T18:00:23.612ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-09T17:52:21.456201Z, time_modified: 2024-09-09T17:52:21.456201Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, db_silo: Silo { identity: SiloIdentity { id: 8dd86d6f-ad2d-45da-852c-8351c18c2cc5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-09T17:52:54.463875Z, time_modified: 2024-09-09T17:52:54.463875Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557" }] }) }
99002024-09-09T18:00:23.612ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 172.607682ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]}},"default_endpoint":{"silo_id":"8dd86d6f-ad2d-45da-852c-8351c18c2cc5","tls_certs":["1894c6395a79bd17ebc1c0c7cfebb44ee3e8b394f3a2b4953f8e9b64fc030557"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
99012024-09-09T18:00:23.618ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
99022024-09-09T18:00:23.618ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99032024-09-09T18:00:23.619ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6310d453-c2a2-41b8-9fc5-2c8035c9fe28", "content-length": "26", "date": "Mon, 09 Sep 2024 18:00:23 GMT"} })
99042024-09-09T18:00:23.619ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99052024-09-09T18:00:23.622ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99062024-09-09T18:00:23.623ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 183.270794ms iteration = 19 status = {"physical_disks_added":0}
99072024-09-09T18:00:23.625ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99082024-09-09T18:00:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99092024-09-09T18:00:23.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 6876ad14-3444-4f27-bec4-3b1fee2ecfa7 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
99102024-09-09T18:00:23.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 6876ad14-3444-4f27-bec4-3b1fee2ecfa7 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
99112024-09-09T18:00:23.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 6876ad14-3444-4f27-bec4-3b1fee2ecfa7 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
99122024-09-09T18:00:23.698ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f zone_address = fd00:1122:3344:101::2
99132024-09-09T18:00:23.698ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99142024-09-09T18:00:23.698ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f6f7fb9e-7d53-40fa-b960-4b7f09b1e70f", "content-length": "26", "date": "Mon, 09 Sep 2024 18:00:23 GMT"} })
99152024-09-09T18:00:23.698ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99162024-09-09T18:00:23.700ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
99172024-09-09T18:00:23.724ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 284.509477ms iteration = 17 status = {}
99182024-09-09T18:00:23.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99192024-09-09T18:00:23.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99202024-09-09T18:00:23.726ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99212024-09-09T18:00:23.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99222024-09-09T18:00:23.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99232024-09-09T18:00:23.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99242024-09-09T18:00:23.729ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99252024-09-09T18:00:23.730ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
99262024-09-09T18:00:23.731ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1f209c5e-86a3-4d36-9e61-1a551b612b22", "date": "Mon, 09 Sep 2024 18:00:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99272024-09-09T18:00:23.731ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99282024-09-09T18:00:23.732ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99292024-09-09T18:00:23.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99302024-09-09T18:00:23.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99312024-09-09T18:00:23.733ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "aa22845a-59de-436e-8bfa-64936d1e346f", "date": "Mon, 09 Sep 2024 18:00:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99322024-09-09T18:00:23.733ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99332024-09-09T18:00:23.734ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99342024-09-09T18:00:23.734ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99352024-09-09T18:00:23.734ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 294.520636ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
99362024-09-09T18:00:23.735ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b8cfa4c7-0c00-40cd-9313-ec468033d032", "content-length": "372", "date": "Mon, 09 Sep 2024 18:00:23 GMT"} })
99372024-09-09T18:00:23.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99382024-09-09T18:00:23.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99392024-09-09T18:00:23.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99402024-09-09T18:00:23.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99412024-09-09T18:00:23.738ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
99422024-09-09T18:00:23.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99432024-09-09T18:00:23.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99442024-09-09T18:00:23.742ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99452024-09-09T18:00:23.743ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ec71de6e-e01a-426f-add5-0332bae6be51", "date": "Mon, 09 Sep 2024 18:00:23 GMT"} })
99462024-09-09T18:00:23.746ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 305.648551ms iteration = 19 status = {}
99472024-09-09T18:00:23.758ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
99482024-09-09T18:00:23.759ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8f34faba-55ce-4f09-afdc-2080b6d33987", "content-length": "2", "date": "Mon, 09 Sep 2024 18:00:22 GMT"} })
99492024-09-09T18:00:23.761ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99502024-09-09T18:00:23.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99512024-09-09T18:00:23.763ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 323.118773ms iteration = 17 status = null
99522024-09-09T18:00:23.870ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
99532024-09-09T18:00:23.871ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "33df4608-ead5-4c6a-bae1-11fa5da873b5", "date": "Mon, 09 Sep 2024 18:00:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99542024-09-09T18:00:23.871ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99552024-09-09T18:00:23.873ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "144c42ef-a61c-46bd-bc10-89b18179c85d", "date": "Mon, 09 Sep 2024 18:00:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99562024-09-09T18:00:23.873ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99572024-09-09T18:00:23.875ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "96d4f83c-51f7-4c06-9af0-59ff4a5510a2", "date": "Mon, 09 Sep 2024 18:00:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99582024-09-09T18:00:23.875ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99592024-09-09T18:00:23.877ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99602024-09-09T18:00:23.877ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 437.375603ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
99612024-09-09T18:00:23.900ZDEBGnexus (BackgroundTasks): client request SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99622024-09-09T18:00:23.900ZDEBGnexus (BackgroundTasks): client response SledAgent = 61e07fcc-45b4-4b25-ae0d-e78eee62eb60 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4b097ddb-fae0-47dd-854b-d4315b9b090a", "content-length": "691", "date": "Mon, 09 Sep 2024 18:00:23 GMT"} })
99632024-09-09T18:00:23.900ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
99642024-09-09T18:00:23.900ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
99652024-09-09T18:00:23.900ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
99662024-09-09T18:00:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 462.358949ms iteration = 18 status = {}
99672024-09-09T18:00:23.934ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99682024-09-09T18:00:23.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99692024-09-09T18:00:23.936ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 8ddbbc53-8b49-46f3-8c46-10ed4300f6d2, rack_id: 1068bc7e-e3ab-44f6-b097-299854b0081f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e) } rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
99702024-09-09T18:00:23.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99712024-09-09T18:00:23.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99722024-09-09T18:00:23.946ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99732024-09-09T18:00:23.946ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bf4da623-6241-49c6-90cb-0eadcaa041d4", "content-length": "121", "date": "Mon, 09 Sep 2024 18:00:22 GMT"} })
99742024-09-09T18:00:23.946ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
99752024-09-09T18:00:23.946ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0d34f6bb-2e02-4b4e-8cf9-32190b5c4a9e
99762024-09-09T18:00:23.946ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99772024-09-09T18:00:23.946ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99782024-09-09T18:00:23.946ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
99792024-09-09T18:00:23.946ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f routes = {}
99802024-09-09T18:00:23.946ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f
99812024-09-09T18:00:23.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99822024-09-09T18:00:23.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99832024-09-09T18:00:23.948ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99842024-09-09T18:00:23.949ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d217166c-c341-42d6-94b5-f97d0f20118e", "content-length": "2", "date": "Mon, 09 Sep 2024 18:00:22 GMT"} })
99852024-09-09T18:00:23.949ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99862024-09-09T18:00:23.949ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c092cacf-fd87-4dbf-8fc7-77f88a80f845", "content-length": "51", "date": "Mon, 09 Sep 2024 18:00:22 GMT"} })
99872024-09-09T18:00:23.949ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch_location = Switch0
99882024-09-09T18:00:23.949ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99892024-09-09T18:00:24.135ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3a591874-b9d9-402c-962c-9dc8fb2822c4", "date": "Mon, 09 Sep 2024 18:00:23 GMT"} })
99902024-09-09T18:00:24.135ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f switch = Switch0
99912024-09-09T18:00:24.135ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99922024-09-09T18:00:24.136ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1068bc7e-e3ab-44f6-b097-299854b0081f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8087eecb-ce10-4d91-9833-b7da45e16828", "content-length": "667", "date": "Mon, 09 Sep 2024 18:00:24 GMT"} })
99932024-09-09T18:00:24.136ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99942024-09-09T18:00:24.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99952024-09-09T18:00:24.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99962024-09-09T18:00:24.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99972024-09-09T18:00:24.144ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99982024-09-09T18:00:24.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99992024-09-09T18:00:24.146ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100002024-09-09T18:00:24.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100012024-09-09T18:00:24.154ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 713.675722ms iteration = 17 status = {}
100022024-09-09T18:00:24.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = e08c2576-24cd-4616-9689-136da0b56f05 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100032024-09-09T18:00:24.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = e08c2576-24cd-4616-9689-136da0b56f05 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100042024-09-09T18:00:24.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = e08c2576-24cd-4616-9689-136da0b56f05 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100052024-09-09T18:00:25.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = d88feb52-55ff-41fa-9e95-a46b5cea8950 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100062024-09-09T18:00:25.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = d88feb52-55ff-41fa-9e95-a46b5cea8950 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100072024-09-09T18:00:25.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2757 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = d88feb52-55ff-41fa-9e95-a46b5cea8950 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100082024-09-09T18:00:25.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1390 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = b8d0d8a7-3bc8-40c4-8b85-724357b28b48 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
100092024-09-09T18:00:25.690ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
100102024-09-09T18:00:25.690ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
100112024-09-09T18:00:25.722ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
100122024-09-09T18:00:25.722ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:33794
100132024-09-09T18:00:25.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:33794 req_id = 17f4f665-a731-46eb-bb45-689653ef143f roles = RoleSet { roles: {} } uri = /metrics/producers
100142024-09-09T18:00:25.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:33794 req_id = 17f4f665-a731-46eb-bb45-689653ef143f resource = Database result = Ok(()) uri = /metrics/producers
100152024-09-09T18:00:25.755ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
100162024-09-09T18:00:25.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:33794 req_id = 17f4f665-a731-46eb-bb45-689653ef143f roles = RoleSet { roles: {} } uri = /metrics/producers
100172024-09-09T18:00:25.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:33794 req_id = 17f4f665-a731-46eb-bb45-689653ef143f resource = Database result = Ok(()) uri = /metrics/producers
100182024-09-09T18:00:25.803ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
100192024-09-09T18:00:25.803ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d788ca7b-ca63-4708-ac8a-1078f0b302ca", "date": "Mon, 09 Sep 2024 18:00:25 GMT"} })
100202024-09-09T18:00:25.803ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 4c6ef9f1-4001-4c65-ae99-bafe915b66f8
100212024-09-09T18:00:25.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 82503 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:33794 req_id = 17f4f665-a731-46eb-bb45-689653ef143f response_code = 201 uri = /metrics/producers
100222024-09-09T18:00:25.804ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "17f4f665-a731-46eb-bb45-689653ef143f", "content-length": "41", "date": "Mon, 09 Sep 2024 18:00:25 GMT"} })
100232024-09-09T18:00:25.805ZDEBGnexus (producer-registration-task): registered with nexus successfully
100242024-09-09T18:00:25.805ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
100252024-09-09T18:00:26.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 756833ba-e5a8-40c5-bb3a-67ed5318344b roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100262024-09-09T18:00:26.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 756833ba-e5a8-40c5-bb3a-67ed5318344b resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100272024-09-09T18:00:26.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 756833ba-e5a8-40c5-bb3a-67ed5318344b response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100282024-09-09T18:00:26.821ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:54408
100292024-09-09T18:00:26.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54408 req_id = efc41079-d3f4-4040-bdaa-17e105b5cb35 roles = RoleSet { roles: {} } uri = /metrics/producers
100302024-09-09T18:00:26.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54408 req_id = efc41079-d3f4-4040-bdaa-17e105b5cb35 resource = Database result = Ok(()) uri = /metrics/producers
100312024-09-09T18:00:26.854ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639
100322024-09-09T18:00:26.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54408 req_id = efc41079-d3f4-4040-bdaa-17e105b5cb35 roles = RoleSet { roles: {} } uri = /metrics/producers
100332024-09-09T18:00:26.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54408 req_id = efc41079-d3f4-4040-bdaa-17e105b5cb35 resource = Database result = Ok(()) uri = /metrics/producers
100342024-09-09T18:00:26.891ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 uri = http://[fd00:1122:3344:101::d]:12223/producers
100352024-09-09T18:00:26.892ZDEBGnexus: client response oximeter-collector = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "be6da8b9-3706-4775-9e82-c9fbf9087746", "date": "Mon, 09 Sep 2024 18:00:26 GMT"} })
100362024-09-09T18:00:26.892ZINFOnexus: assigned collector to new producer collector_id = fe9e311d-41c3-4a6e-8e3e-3fbb54dee639 file = nexus/src/app/oximeter.rs:125 producer_id = 283b8781-e2cd-4d76-a776-70a483efe054
100372024-09-09T18:00:26.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 73004 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54408 req_id = efc41079-d3f4-4040-bdaa-17e105b5cb35 response_code = 201 uri = /metrics/producers
100382024-09-09T18:00:27.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = cd0e5ae1-0407-46c2-b9b4-793744359d7c roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100392024-09-09T18:00:27.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = cd0e5ae1-0407-46c2-b9b4-793744359d7c resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100402024-09-09T18:00:27.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2501 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = cd0e5ae1-0407-46c2-b9b4-793744359d7c response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100412024-09-09T18:00:28.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = fd49d814-09cd-4ad3-8922-846e028bb9a0 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100422024-09-09T18:00:28.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = fd49d814-09cd-4ad3-8922-846e028bb9a0 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100432024-09-09T18:00:28.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = fd49d814-09cd-4ad3-8922-846e028bb9a0 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100442024-09-09T18:00:29.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bb6b45d8-f968-4611-bbe8-97c1bd3eb9d5 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100452024-09-09T18:00:29.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bb6b45d8-f968-4611-bbe8-97c1bd3eb9d5 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100462024-09-09T18:00:29.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = bb6b45d8-f968-4611-bbe8-97c1bd3eb9d5 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100472024-09-09T18:00:30.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 02e3081a-2f75-4adf-b2a3-f19c3ba5f300 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100482024-09-09T18:00:30.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 02e3081a-2f75-4adf-b2a3-f19c3ba5f300 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100492024-09-09T18:00:30.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 02e3081a-2f75-4adf-b2a3-f19c3ba5f300 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100502024-09-09T18:00:31.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 638f50f9-e067-4f6f-b186-e25697046205 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100512024-09-09T18:00:31.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 638f50f9-e067-4f6f-b186-e25697046205 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100522024-09-09T18:00:31.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 638f50f9-e067-4f6f-b186-e25697046205 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100532024-09-09T18:00:32.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 6161c076-c666-4cce-9b94-e9ca0af11682 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100542024-09-09T18:00:32.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 6161c076-c666-4cce-9b94-e9ca0af11682 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100552024-09-09T18:00:32.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 6161c076-c666-4cce-9b94-e9ca0af11682 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100562024-09-09T18:00:33.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
100572024-09-09T18:00:33.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100582024-09-09T18:00:33.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100592024-09-09T18:00:33.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
100602024-09-09T18:00:33.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100612024-09-09T18:00:33.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100622024-09-09T18:00:33.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100632024-09-09T18:00:33.474ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100642024-09-09T18:00:33.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100652024-09-09T18:00:33.475ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100662024-09-09T18:00:33.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100672024-09-09T18:00:33.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100682024-09-09T18:00:33.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100692024-09-09T18:00:33.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100702024-09-09T18:00:33.478ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100712024-09-09T18:00:33.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
100722024-09-09T18:00:33.480ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100732024-09-09T18:00:33.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100742024-09-09T18:00:33.486ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
100752024-09-09T18:00:33.487ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.613893ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
100762024-09-09T18:00:33.503ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.399276ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100772024-09-09T18:00:33.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1cc49d62-971e-4534-b94d-780e6bd07084 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100782024-09-09T18:00:33.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1cc49d62-971e-4534-b94d-780e6bd07084 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100792024-09-09T18:00:33.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1cc49d62-971e-4534-b94d-780e6bd07084 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100802024-09-09T18:00:34.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 5e19b736-325d-46f7-bebb-b2b0483fdcc2 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100812024-09-09T18:00:34.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 5e19b736-325d-46f7-bebb-b2b0483fdcc2 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100822024-09-09T18:00:34.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 5e19b736-325d-46f7-bebb-b2b0483fdcc2 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100832024-09-09T18:00:35.806ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1439 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = 117e1490-2a12-47d5-bb39-3b6ab94cb356 response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
100842024-09-09T18:00:35.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f98f298a-cb67-4f29-b7f8-9d6014aadc31 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100852024-09-09T18:00:35.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f98f298a-cb67-4f29-b7f8-9d6014aadc31 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100862024-09-09T18:00:35.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = f98f298a-cb67-4f29-b7f8-9d6014aadc31 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100872024-09-09T18:00:36.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 6be5eb09-8830-465f-8260-d41af14dcf69 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100882024-09-09T18:00:36.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 6be5eb09-8830-465f-8260-d41af14dcf69 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100892024-09-09T18:00:36.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 6be5eb09-8830-465f-8260-d41af14dcf69 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100902024-09-09T18:00:37.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 7b6d8dd7-6e24-4a9c-84b3-a4e28116c0e9 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100912024-09-09T18:00:37.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 7b6d8dd7-6e24-4a9c-84b3-a4e28116c0e9 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100922024-09-09T18:00:37.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2609 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 7b6d8dd7-6e24-4a9c-84b3-a4e28116c0e9 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100932024-09-09T18:00:38.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 0c11fe7e-5268-41b6-b563-1ce3344a33a7 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100942024-09-09T18:00:38.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 0c11fe7e-5268-41b6-b563-1ce3344a33a7 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100952024-09-09T18:00:38.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 0c11fe7e-5268-41b6-b563-1ce3344a33a7 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100962024-09-09T18:00:39.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 71c31b00-a1e0-4a6f-8709-4aa9c0b082b8 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100972024-09-09T18:00:39.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 71c31b00-a1e0-4a6f-8709-4aa9c0b082b8 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100982024-09-09T18:00:39.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 71c31b00-a1e0-4a6f-8709-4aa9c0b082b8 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
100992024-09-09T18:00:41.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = c933b41f-a912-4a48-a7c3-2a4fc8ad7537 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101002024-09-09T18:00:41.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = c933b41f-a912-4a48-a7c3-2a4fc8ad7537 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101012024-09-09T18:00:41.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = c933b41f-a912-4a48-a7c3-2a4fc8ad7537 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101022024-09-09T18:00:42.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 26fddd10-adc6-4c66-9bdb-3152b26d2e46 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101032024-09-09T18:00:42.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 26fddd10-adc6-4c66-9bdb-3152b26d2e46 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101042024-09-09T18:00:42.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 26fddd10-adc6-4c66-9bdb-3152b26d2e46 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101052024-09-09T18:00:43.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b3d61aba-2bf5-4ab1-958b-3010425738d5 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101062024-09-09T18:00:43.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b3d61aba-2bf5-4ab1-958b-3010425738d5 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101072024-09-09T18:00:43.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b3d61aba-2bf5-4ab1-958b-3010425738d5 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101082024-09-09T18:00:43.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
101092024-09-09T18:00:43.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101102024-09-09T18:00:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101112024-09-09T18:00:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
101122024-09-09T18:00:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101132024-09-09T18:00:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101142024-09-09T18:00:43.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101152024-09-09T18:00:43.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101162024-09-09T18:00:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101172024-09-09T18:00:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101182024-09-09T18:00:43.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101192024-09-09T18:00:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101202024-09-09T18:00:43.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101212024-09-09T18:00:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101222024-09-09T18:00:43.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101232024-09-09T18:00:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c5ff7180-161c-42a8-859a-c0943c5fd89b, lookup_type: ById(c5ff7180-161c-42a8-859a-c0943c5fd89b) } result = Ok(())
101242024-09-09T18:00:43.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101252024-09-09T18:00:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101262024-09-09T18:00:43.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b original_time_created = 2024-09-09 17:52:00.527752 UTC target_id = c5ff7180-161c-42a8-859a-c0943c5fd89b time_created = 2024-09-09 17:52:00.527752 UTC
101272024-09-09T18:00:43.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.149894ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c5ff7180-161c-42a8-859a-c0943c5fd89b","time_created":"2024-09-09T17:52:00.527752Z"}
101282024-09-09T18:00:43.472ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.267314ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101292024-09-09T18:00:44.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = e763e6f8-454c-4eca-ad86-725e845b476a roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101302024-09-09T18:00:44.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = e763e6f8-454c-4eca-ad86-725e845b476a resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101312024-09-09T18:00:44.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = e763e6f8-454c-4eca-ad86-725e845b476a response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101322024-09-09T18:00:45.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b3cd991d-195a-4ca8-8e87-8c403c225862 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101332024-09-09T18:00:45.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b3cd991d-195a-4ca8-8e87-8c403c225862 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101342024-09-09T18:00:45.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2768 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = b3cd991d-195a-4ca8-8e87-8c403c225862 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101352024-09-09T18:00:45.806ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1656 local_addr = [fd00:1122:3344:101::c]:48561 method = GET remote_addr = [fd00:1122:3344:101::d]:56239 req_id = e85b7a06-2a2f-41f6-ba16-19f66ad9c91d response_code = 200 uri = /4c6ef9f1-4001-4c65-ae99-bafe915b66f8
101362024-09-09T18:00:46.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 4ef215b6-ef09-4989-b307-6f9c730d8571 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101372024-09-09T18:00:46.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 4ef215b6-ef09-4989-b307-6f9c730d8571 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101382024-09-09T18:00:46.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 4ef215b6-ef09-4989-b307-6f9c730d8571 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101392024-09-09T18:00:47.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = eedb1a38-2be4-4411-9048-a5ba7a3b0ceb roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101402024-09-09T18:00:47.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = eedb1a38-2be4-4411-9048-a5ba7a3b0ceb resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101412024-09-09T18:00:47.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = eedb1a38-2be4-4411-9048-a5ba7a3b0ceb response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101422024-09-09T18:00:48.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1c3feeef-811c-4f59-a5b7-c01a13b85b39 roles = RoleSet { roles: {} } uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101432024-09-09T18:00:48.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1c3feeef-811c-4f59-a5b7-c01a13b85b39 resource = Database result = Ok(()) uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60
101442024-09-09T18:00:48.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44885 req_id = 1c3feeef-811c-4f59-a5b7-c01a13b85b39 response_code = 200 uri = /probes/61e07fcc-45b4-4b25-ae0d-e78eee62eb60